Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5156 originally caused by: Started by upstream project "master-osmo-pcu" build number 5363 originally caused by: Started by upstream project "master-libosmo-gprs" build number 137 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3912 originally caused by: Started by upstream project "master-osmo-pcu" build number 5363 originally caused by: Started by upstream project "master-libosmo-gprs" build number 137 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17686 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7515 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8719 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8964 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2995 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29315 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5156 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30101 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4686 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12995 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9260 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4714 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5195 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3912 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins5902118042259214113.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 06:56:55 + trial_dir_prefix=trial- + rm -rf trial-2400 trial-2400-bin.tgz trial-2400-run.tgz + trial_dir=trial-2401 + mkdir -p trial-2401 + mv open5gs.build-8.tgz osmo-bsc.build-17686.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2995.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29315.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3912.tgz osmo-pcu-sysmo.build-5195.tgz osmo-pcu.build-5156.tgz osmo-sgsn.build-30101.tgz osmo-stp.build-9260.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz trial-2401 + cat open5gs.build-8.md5 osmo-bsc.build-17686.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2995.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29315.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3912.md5 osmo-pcu-sysmo.build-5195.md5 osmo-pcu.build-5156.md5 osmo-sgsn.build-30101.md5 osmo-stp.build-9260.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17686.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2995.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29315.md5 osmo-nitb.build-12995.md5 osmo-pcu-oc2g.build-3912.md5 osmo-pcu-sysmo.build-5195.md5 osmo-pcu.build-5156.md5 osmo-sgsn.build-30101.md5 osmo-stp.build-9260.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2401 combinations: None trial: 'trial-2401' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2401 -------------------------------------------------------------------------------------------- 06:57:06.479067 tst trial-2401: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/log --------------------------------------------------------------------- trial-2401 nitb_sms:sysmo --------------------------------------------------------------------- 06:59:13.380169 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:13.384539 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 06:59:13.405580 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 06:59:13.412756 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 06:59:13.467524 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 06:59:13.489568 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 06:59:13.496367 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 06:59:14.031412 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 06:59:14.036594 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 06:59:14.047662 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 06:59:14.422394 tst mo_mt_sms.py: using LAC 39196 06:59:14.656681 tst mo_mt_sms.py: using RAC 181 06:59:14.770211 tst mo_mt_sms.py: using CellId 39196 06:59:14.885589 tst mo_mt_sms.py: using BVCI 39197 06:59:14.990637 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 06:59:15.172906 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 06:59:15.288794 tst mo_mt_sms.py:9: start nitb and bts... 06:59:15.490875 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:59:17.909464 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20172): Launched 06:59:18.215039 run osmo-nitb_10.42.42.2(pid=20173): Launched 06:59:18.378936 run osmo-nitb_10.42.42.2(pid=20173): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20173)] 06:59:18.502199 run osmo-nitb_10.42.42.2(pid=20173): stdout: | (launched: 2022-12-14_06:59:18.156889) 06:59:18.627193 run osmo-nitb_10.42.42.2(pid=20173): stderr: | (launched: 2022-12-14_06:59:18.202470) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:59:18.752275 run osmo-nitb_10.42.42.2(pid=20173): stdout: | (launched: 2022-12-14_06:59:18.156889) 06:59:18.871349 run osmo-nitb_10.42.42.2(pid=20173): stderr: | (launched: 2022-12-14_06:59:18.202470) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:59:19.014778 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20173): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20173) [trial-2401↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20173)] [trial-2401↪nitb_sms:sysmo↪mo_mt_sms.py:11] 06:59:19.022912 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 06:59:19.029448 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20172): Terminating (SIGTERM) 06:59:19.238375 --- ParallelTerminationStrategy: PID 20172 died... 06:59:19.259203 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20172): Terminated: ok {rc=0} 06:59:19.344262 bus /sierra_3: Setting Powered False 06:59:20.443020 bus /sierra_3: Setting Powered False 06:59:21.563685 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 sms:sysmo --------------------------------------------------------------------- 06:59:22.746841 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:22.751138 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 06:59:22.772367 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 06:59:22.799823 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 06:59:22.853561 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 06:59:22.875115 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 06:59:22.902078 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 06:59:23.447084 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 sms:sysmo mo_mt_sms.py ---------------------------------------------- 06:59:23.452086 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:59:23.462736 tst sms:sysmo: Using 1 x bts (candidates: 1) 06:59:23.496402 tst mo_mt_sms.py: using LAC 39197 06:59:23.616017 tst mo_mt_sms.py: using RAC 182 06:59:23.735403 tst mo_mt_sms.py: using CellId 39197 06:59:23.862886 tst mo_mt_sms.py: using BVCI 39198 06:59:23.981806 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:59:23.992687 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:59:24.003670 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:59:24.014544 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:59:24.025689 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:59:24.036471 tst sms:sysmo: Using 1 x modem (candidates: 2) 06:59:24.153344 tst sms:sysmo: Using 1 x modem (candidates: 2) 06:59:24.275415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:26.030986 run create_hlr_db(pid=20177): Launched 06:59:26.153645 bus /sierra_2: Setting Powered False 06:59:27.217263 run create_hlr_db(pid=20177): Terminated: ok {rc=0} 06:59:27.652509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20179): Launched 06:59:27.957203 run osmo-hlr_10.42.42.2(pid=20180): Launched 06:59:28.072693 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:30.542282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20182): Launched 06:59:30.853687 run osmo-stp_10.42.42.5(pid=20183): Launched 06:59:31.094903 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:36.720223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20185): Launched 06:59:37.044596 run osmo-msc_10.42.42.6(pid=20186): Launched 06:59:37.223865 run osmo-stp_10.42.42.5(pid=20183): ERR: Terminated: ERROR {rc=1} [trial-2401↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20183)] 06:59:37.359658 run osmo-stp_10.42.42.5(pid=20183): stdout: | (launched: 2022-12-14_06:59:30.789161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:37.497561 run osmo-stp_10.42.42.5(pid=20183): stderr: | 20221214065931084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065931084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065931084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065931085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065931085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065931086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065931086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:37.633454 run osmo-stp_10.42.42.5(pid=20183): stdout: | (launched: 2022-12-14_06:59:30.789161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:37.761994 run osmo-stp_10.42.42.5(pid=20183): stderr: | 20221214065931084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065931084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065931084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065931085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065931085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065931086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065931086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:37.915910 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20183): Process ended prematurely: osmo-stp_10.42.42.5(pid=20183) [trial-2401↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20183)] [trial-2401↪sms:sysmo↪mo_mt_sms.py:16] 06:59:37.924629 tst mo_mt_sms.py:16: Test FAILED (14.5 sec) 06:59:37.952024 run osmo-hlr_10.42.42.2(pid=20180): ERR: Terminated: ERROR {rc=237} [trial-2401↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20180)] 06:59:38.002335 run osmo-hlr_10.42.42.2(pid=20180): stdout: | (launched: 2022-12-14_06:59:27.899762) 06:59:38.054481 run osmo-hlr_10.42.42.2(pid=20180): stderr: | 20221214065928080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065928080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065928080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065928080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065928080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065928080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065928092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065928102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065928102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065928102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:38.127021 run osmo-msc_10.42.42.6(pid=20186): ERR: Terminated: ERROR {rc=2} [trial-2401↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20186)] 06:59:38.177350 run osmo-msc_10.42.42.6(pid=20186): stdout: | (launched: 2022-12-14_06:59:36.983775) 06:59:38.229575 run osmo-msc_10.42.42.6(pid=20186): stderr: | 20221214065937313 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065937313 DLGLOBAL DEBUG validating counter group 0x7f50d29a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065937313 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065937313 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065937313 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065937314 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065937315 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065937316 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065937316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065937316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:38.281891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20179): Terminating (SIGTERM) 06:59:38.323936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20182): Terminating (SIGTERM) 06:59:38.366160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20185): Terminating (SIGTERM) 06:59:38.408338 --- ParallelTerminationStrategy: PID 20179 died... 06:59:38.428500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20179): Terminated: ok {rc=0} 06:59:38.475209 --- ParallelTerminationStrategy: PID 20182 died... 06:59:38.494923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20182): Terminated: ok {rc=0} 06:59:38.541219 --- ParallelTerminationStrategy: PID 20185 died... 06:59:38.560640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20185): Terminated: ok {rc=0} 06:59:38.648679 bus /sierra_3: Setting Powered False 06:59:39.746754 bus /sierra_3: Setting Powered False 06:59:40.864704 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_ussd:sysmo --------------------------------------------------------------------- 06:59:42.125308 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:42.129708 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 06:59:42.151441 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 06:59:42.158926 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 06:59:42.195587 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 06:59:42.216828 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 06:59:42.223778 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 06:59:42.743616 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 06:59:42.749502 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 06:59:42.760057 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 06:59:42.794038 tst assert_extension.py: using LAC 39198 06:59:42.914262 tst assert_extension.py: using RAC 183 06:59:43.034995 tst assert_extension.py: using CellId 39198 06:59:43.155829 tst assert_extension.py: using BVCI 39199 06:59:43.266990 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 06:59:43.387291 tst assert_extension.py:10: start nitb and bts... 06:59:43.607546 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:59:44.269475 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20191): Launched 06:59:44.596814 run osmo-nitb_10.42.42.2(pid=20192): Launched 06:59:44.775400 run osmo-nitb_10.42.42.2(pid=20192): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20192)] 06:59:44.919475 run osmo-nitb_10.42.42.2(pid=20192): stdout: | (launched: 2022-12-14_06:59:44.535661) 06:59:45.065124 run osmo-nitb_10.42.42.2(pid=20192): stderr: | (launched: 2022-12-14_06:59:44.584118) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:59:45.210707 run osmo-nitb_10.42.42.2(pid=20192): stdout: | (launched: 2022-12-14_06:59:44.535661) 06:59:45.350276 run osmo-nitb_10.42.42.2(pid=20192): stderr: | (launched: 2022-12-14_06:59:44.584118) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20192): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20192) [trial-2401↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20192)] 06:59:45.718434 tst osmo-nitb_10.42.42.2(pid=20192): stdout: | (launched: 2022-12-14_06:59:44.535661) 06:59:45.849648 tst osmo-nitb_10.42.42.2(pid=20192): stderr: | (launched: 2022-12-14_06:59:44.584118) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:59:46.007725 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20192): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20192) [trial-2401↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20192)] [trial-2401↪nitb_ussd:sysmo↪assert_extension.py:12] 06:59:46.017720 tst assert_extension.py:12: Test FAILED (3.3 sec) 06:59:46.025778 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20191): Terminating (SIGTERM) 06:59:46.237508 --- ParallelTerminationStrategy: PID 20191 died... 06:59:46.258151 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20191): Terminated: ok {rc=0} 06:59:46.348722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 ussd:sysmo --------------------------------------------------------------------- 06:59:47.514377 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:47.518592 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 06:59:47.540487 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 06:59:47.569417 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 06:59:47.605927 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 06:59:47.627413 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 06:59:47.654818 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 06:59:48.182549 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 ussd:sysmo assert_extension.py ---------------------------------------------- 06:59:48.187705 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:59:48.198840 tst ussd:sysmo: Using 1 x bts (candidates: 1) 06:59:48.233588 tst assert_extension.py: using LAC 39199 06:59:48.353987 tst assert_extension.py: using RAC 184 06:59:48.474601 tst assert_extension.py: using CellId 39199 06:59:48.594172 tst assert_extension.py: using BVCI 39200 06:59:48.705206 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:59:48.715844 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:59:48.726372 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:59:48.736734 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:59:48.747232 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:59:48.757608 tst ussd:sysmo: Using 1 x modem (candidates: 1) 06:59:48.877731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:49.382932 run create_hlr_db(pid=20196): Launched 06:59:49.507306 bus /sierra_2: Setting Powered False 06:59:50.571399 run create_hlr_db(pid=20196): Terminated: ok {rc=0} 06:59:51.025569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20198): Launched 06:59:51.354029 run osmo-hlr_10.42.42.2(pid=20199): Launched 06:59:51.478418 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:52.039789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20201): Launched 06:59:52.366683 run osmo-stp_10.42.42.5(pid=20202): Launched 06:59:52.491221 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:53.076269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20204): Launched 06:59:53.403755 run osmo-msc_10.42.42.6(pid=20205): Launched 06:59:53.585783 run osmo-stp_10.42.42.5(pid=20202): ERR: Terminated: ERROR {rc=1} [trial-2401↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20202)] 06:59:53.723626 run osmo-stp_10.42.42.5(pid=20202): stdout: | (launched: 2022-12-14_06:59:52.305589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:53.861988 run osmo-stp_10.42.42.5(pid=20202): stderr: | 20221214065952499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065952500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065952500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065952500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065952501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065952501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065952501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:53.998919 run osmo-stp_10.42.42.5(pid=20202): stdout: | (launched: 2022-12-14_06:59:52.305589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:54.128468 run osmo-stp_10.42.42.5(pid=20202): stderr: | 20221214065952499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214065952500 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214065952500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214065952500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214065952501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214065952501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214065952501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:54.283771 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20202): Process ended prematurely: osmo-stp_10.42.42.5(pid=20202) [trial-2401↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20202)] [trial-2401↪ussd:sysmo↪assert_extension.py:17] 06:59:54.292570 tst assert_extension.py:17: Test FAILED (6.1 sec) 06:59:54.320000 run osmo-hlr_10.42.42.2(pid=20199): ERR: Terminated: ERROR {rc=237} [trial-2401↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20199)] 06:59:54.371566 run osmo-hlr_10.42.42.2(pid=20199): stdout: | (launched: 2022-12-14_06:59:51.292422) 06:59:54.424030 run osmo-hlr_10.42.42.2(pid=20199): stderr: | 20221214065951492 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214065951492 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214065951492 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214065951493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214065951493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214065951493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214065951506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214065951514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214065951515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214065951515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:54.497556 run osmo-msc_10.42.42.6(pid=20205): ERR: Terminated: ERROR {rc=2} [trial-2401↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20205)] 06:59:54.548877 run osmo-msc_10.42.42.6(pid=20205): stdout: | (launched: 2022-12-14_06:59:53.342494) 06:59:54.601701 run osmo-msc_10.42.42.6(pid=20205): stderr: | 20221214065953666 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214065953666 DLGLOBAL DEBUG validating counter group 0x7fc1e555ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214065953666 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214065953666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214065953666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214065953667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214065953668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214065953669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214065953669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214065953669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:54.654935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20198): Terminating (SIGTERM) 06:59:54.697154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20201): Terminating (SIGTERM) 06:59:54.739797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20204): Terminating (SIGTERM) 06:59:54.782787 --- ParallelTerminationStrategy: PID 20198 died... 06:59:54.803355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20198): Terminated: ok {rc=0} 06:59:54.850155 --- ParallelTerminationStrategy: PID 20201 died... 06:59:54.870348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20201): Terminated: ok {rc=0} 06:59:54.917172 --- ParallelTerminationStrategy: PID 20204 died... 06:59:54.937075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20204): Terminated: ok {rc=0} 06:59:55.025630 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:59:56.219277 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:56.225993 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:59:56.246946 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:59:56.275086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:59:56.326613 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:59:56.347285 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:59:56.374160 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:59:56.924138 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:59:56.975964 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:59:56.986992 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:59:57.043254 tst mo_mt_call.py: using LAC 39200 06:59:57.166457 tst mo_mt_call.py: using RAC 185 06:59:57.288762 tst mo_mt_call.py: using CellId 39200 06:59:57.411734 tst mo_mt_call.py: using BVCI 39201 06:59:57.525289 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:59:57.536268 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:59:57.547139 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:59:57.558065 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:59:57.568861 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:59:57.579820 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:59:57.702720 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:59:57.821351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:58.298541 run create_hlr_db(pid=20211): Launched 06:59:58.423341 bus /sierra_2: Setting Powered False 06:59:59.483997 run create_hlr_db(pid=20211): Terminated: ok {rc=0} 06:59:59.936376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20213): Launched 07:00:00.268777 run osmo-hlr_10.42.42.2(pid=20214): Launched 07:00:00.394971 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:00.981019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20216): Launched 07:00:01.333234 run osmo-stp_10.42.42.5(pid=20217): Launched 07:00:01.608356 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:02.295834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20222): Launched 07:00:02.640635 run osmo-msc_10.42.42.6(pid=20223): Launched 07:00:02.823645 run osmo-stp_10.42.42.5(pid=20217): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20217)] 07:00:02.962433 run osmo-stp_10.42.42.5(pid=20217): stdout: | (launched: 2022-12-14_07:00:01.269750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:03.101542 run osmo-stp_10.42.42.5(pid=20217): stderr: | 20221214070001551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070001551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070001551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070001552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070001552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070001552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070001552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:03.240109 run osmo-stp_10.42.42.5(pid=20217): stdout: | (launched: 2022-12-14_07:00:01.269750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:03.371745 run osmo-stp_10.42.42.5(pid=20217): stderr: | 20221214070001551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070001551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070001551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070001552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070001552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070001552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070001552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:03.529731 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20217): Process ended prematurely: osmo-stp_10.42.42.5(pid=20217) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20217)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:00:03.539290 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:00:03.566712 run osmo-hlr_10.42.42.2(pid=20214): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20214)] 07:00:03.618793 run osmo-hlr_10.42.42.2(pid=20214): stdout: | (launched: 2022-12-14_07:00:00.207171) 07:00:03.671869 run osmo-hlr_10.42.42.2(pid=20214): stderr: | 20221214070000410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070000410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070000410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070000410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070000410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070000410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070000422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070000430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070000430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070000430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:03.745097 run osmo-msc_10.42.42.6(pid=20223): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20223)] 07:00:03.794855 run osmo-msc_10.42.42.6(pid=20223): stdout: | (launched: 2022-12-14_07:00:02.578619) 07:00:03.847928 run osmo-msc_10.42.42.6(pid=20223): stderr: | 20221214070002906 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070002906 DLGLOBAL DEBUG validating counter group 0x7fefc8b0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070002906 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070002906 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070002906 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070002906 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070002908 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070002909 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070002909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070002909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:03.901055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20213): Terminating (SIGTERM) 07:00:03.943015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20216): Terminating (SIGTERM) 07:00:03.985884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20222): Terminating (SIGTERM) 07:00:04.028833 --- ParallelTerminationStrategy: PID 20213 died... 07:00:04.049726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20213): Terminated: ok {rc=0} 07:00:04.097063 --- ParallelTerminationStrategy: PID 20216 died... 07:00:04.117430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20216): Terminated: ok {rc=0} 07:00:04.164577 --- ParallelTerminationStrategy: PID 20222 died... 07:00:04.185172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20222): Terminated: ok {rc=0} 07:00:04.274254 bus /sierra_3: Setting Powered False 07:00:05.372882 bus /sierra_3: Setting Powered False 07:00:06.491873 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:00:07.645504 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:00:07.657815 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:00:07.734384 tst mo_mt_call_osmux.py: using LAC 39201 07:00:07.864694 tst mo_mt_call_osmux.py: using RAC 186 07:00:07.995443 tst mo_mt_call_osmux.py: using CellId 39201 07:00:08.121057 tst mo_mt_call_osmux.py: using BVCI 39202 07:00:08.233428 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:00:08.244529 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:00:08.255705 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:00:08.266785 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:00:08.277701 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:00:08.288434 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:00:08.409667 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:00:08.528613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:09.007371 run create_hlr_db(pid=20225): Launched 07:00:09.133326 bus /sierra_2: Setting Powered False 07:00:10.195296 run create_hlr_db(pid=20225): Terminated: ok {rc=0} 07:00:10.649495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20227): Launched 07:00:10.985507 run osmo-hlr_10.42.42.2(pid=20228): Launched 07:00:11.112754 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:11.684793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20230): Launched 07:00:12.017913 run osmo-stp_10.42.42.5(pid=20231): Launched 07:00:12.143732 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:12.742533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20233): Launched 07:00:13.075987 run osmo-msc_10.42.42.6(pid=20234): Launched 07:00:13.259593 run osmo-stp_10.42.42.5(pid=20231): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20231)] 07:00:13.398892 run osmo-stp_10.42.42.5(pid=20231): stdout: | (launched: 2022-12-14_07:00:11.955599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:13.539254 run osmo-stp_10.42.42.5(pid=20231): stderr: | 20221214070012153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070012154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070012154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070012154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070012155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070012155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070012155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:13.678846 run osmo-stp_10.42.42.5(pid=20231): stdout: | (launched: 2022-12-14_07:00:11.955599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:13.810165 run osmo-stp_10.42.42.5(pid=20231): stderr: | 20221214070012153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070012154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070012154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070012154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070012155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070012155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070012155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:13.967905 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20231): Process ended prematurely: osmo-stp_10.42.42.5(pid=20231) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20231)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:00:13.977364 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:00:14.004916 run osmo-hlr_10.42.42.2(pid=20228): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20228)] 07:00:14.055692 run osmo-hlr_10.42.42.2(pid=20228): stdout: | (launched: 2022-12-14_07:00:10.922970) 07:00:14.108181 run osmo-hlr_10.42.42.2(pid=20228): stderr: | 20221214070011125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070011125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070011125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070011125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070011125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070011125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070011139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070011147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070011148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070011148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:14.180741 run osmo-msc_10.42.42.6(pid=20234): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20234)] 07:00:14.230976 run osmo-msc_10.42.42.6(pid=20234): stdout: | (launched: 2022-12-14_07:00:13.013396) 07:00:14.283355 run osmo-msc_10.42.42.6(pid=20234): stderr: | 20221214070013340 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070013340 DLGLOBAL DEBUG validating counter group 0x7f37e0b3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070013340 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070013340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070013340 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070013341 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070013342 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070013343 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070013343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070013343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:14.335877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20227): Terminating (SIGTERM) 07:00:14.377634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20230): Terminating (SIGTERM) 07:00:14.419786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20233): Terminating (SIGTERM) 07:00:14.462242 --- ParallelTerminationStrategy: PID 20227 died... 07:00:14.482448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20227): Terminated: ok {rc=0} 07:00:14.529186 --- ParallelTerminationStrategy: PID 20230 died... 07:00:14.549133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20230): Terminated: ok {rc=0} 07:00:14.595228 --- ParallelTerminationStrategy: PID 20233 died... 07:00:14.614977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20233): Terminated: ok {rc=0} 07:00:14.703354 bus /sierra_3: Setting Powered False 07:00:15.802092 bus /sierra_3: Setting Powered False 07:00:16.928345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:00:18.180467 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:00:18.187384 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:00:18.208616 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:00:18.237095 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:00:18.291850 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:00:18.312638 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:00:18.339407 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:00:18.889944 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:00:18.939345 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:18.950425 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:00:19.006267 tst mo_mt_call.py: using LAC 39202 07:00:19.129183 tst mo_mt_call.py: using RAC 187 07:00:19.250954 tst mo_mt_call.py: using CellId 39202 07:00:19.373567 tst mo_mt_call.py: using BVCI 39203 07:00:19.485821 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:19.496836 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:19.507766 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:19.518589 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:19.529551 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:19.540410 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:00:19.660430 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:00:19.779748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:20.258651 run create_hlr_db(pid=20241): Launched 07:00:20.384097 bus /sierra_2: Setting Powered False 07:00:21.445196 run create_hlr_db(pid=20241): Terminated: ok {rc=0} 07:00:21.897038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20243): Launched 07:00:22.229448 run osmo-hlr_10.42.42.2(pid=20244): Launched 07:00:22.356269 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:22.930822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20246): Launched 07:00:23.244909 run osmo-stp_10.42.42.5(pid=20247): Launched 07:00:23.361308 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:23.916420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20249): Launched 07:00:24.225315 run osmo-msc_10.42.42.6(pid=20250): Launched 07:00:24.397400 run osmo-stp_10.42.42.5(pid=20247): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20247)] 07:00:24.528100 run osmo-stp_10.42.42.5(pid=20247): stdout: | (launched: 2022-12-14_07:00:23.187013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:24.658483 run osmo-stp_10.42.42.5(pid=20247): stderr: | 20221214070023363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070023363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070023363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070023363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070023364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070023364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070023364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:24.786928 run osmo-stp_10.42.42.5(pid=20247): stdout: | (launched: 2022-12-14_07:00:23.187013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:24.909804 run osmo-stp_10.42.42.5(pid=20247): stderr: | 20221214070023363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070023363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070023363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070023363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070023364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070023364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070023364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:25.056676 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20247): Process ended prematurely: osmo-stp_10.42.42.5(pid=20247) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20247)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:00:25.065436 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:00:25.091287 run osmo-hlr_10.42.42.2(pid=20244): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20244)] 07:00:25.138915 run osmo-hlr_10.42.42.2(pid=20244): stdout: | (launched: 2022-12-14_07:00:22.167514) 07:00:25.187967 run osmo-hlr_10.42.42.2(pid=20244): stderr: | 20221214070022372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070022372 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070022372 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070022372 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070022372 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070022372 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070022384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070022392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070022392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070022392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:25.256218 run osmo-msc_10.42.42.6(pid=20250): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20250)] 07:00:25.303644 run osmo-msc_10.42.42.6(pid=20250): stdout: | (launched: 2022-12-14_07:00:24.167344) 07:00:25.352728 run osmo-msc_10.42.42.6(pid=20250): stderr: | 20221214070024446 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070024446 DLGLOBAL DEBUG validating counter group 0x7f74cd2b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070024446 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070024446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070024446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070024446 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070024448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070024449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070024449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070024449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:25.402159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20243): Terminating (SIGTERM) 07:00:25.441719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20246): Terminating (SIGTERM) 07:00:25.481301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20249): Terminating (SIGTERM) 07:00:25.521616 --- ParallelTerminationStrategy: PID 20243 died... 07:00:25.540518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20243): Terminated: ok {rc=0} 07:00:25.584211 --- ParallelTerminationStrategy: PID 20246 died... 07:00:25.602641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20246): Terminated: ok {rc=0} 07:00:25.646420 --- ParallelTerminationStrategy: PID 20249 died... 07:00:25.665419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20249): Terminated: ok {rc=0} 07:00:25.751657 bus /sierra_3: Setting Powered False 07:00:26.850874 bus /sierra_3: Setting Powered False 07:00:27.965112 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:00:29.111674 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:29.123394 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:00:29.180047 tst mo_mt_call_osmux.py: using LAC 39203 07:00:29.301749 tst mo_mt_call_osmux.py: using RAC 188 07:00:29.424592 tst mo_mt_call_osmux.py: using CellId 39203 07:00:29.548038 tst mo_mt_call_osmux.py: using BVCI 39204 07:00:29.660771 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:29.671983 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:29.682880 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:29.693744 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:29.704569 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:00:29.715524 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:00:29.837977 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:00:29.956717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:30.434114 run create_hlr_db(pid=20252): Launched 07:00:30.559008 bus /sierra_2: Setting Powered False 07:00:31.623772 run create_hlr_db(pid=20252): Terminated: ok {rc=0} 07:00:32.141994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20254): Launched 07:00:32.484818 run osmo-hlr_10.42.42.2(pid=20255): Launched 07:00:32.613412 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:33.190042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20257): Launched 07:00:33.524692 run osmo-stp_10.42.42.5(pid=20258): Launched 07:00:33.651243 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:34.251056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20260): Launched 07:00:34.585039 run osmo-msc_10.42.42.6(pid=20261): Launched 07:00:34.768701 run osmo-stp_10.42.42.5(pid=20258): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20258)] 07:00:34.907553 run osmo-stp_10.42.42.5(pid=20258): stdout: | (launched: 2022-12-14_07:00:33.462275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:35.047245 run osmo-stp_10.42.42.5(pid=20258): stderr: | 20221214070033658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070033659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070033659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070033659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070033660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070033660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070033660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:35.186333 run osmo-stp_10.42.42.5(pid=20258): stdout: | (launched: 2022-12-14_07:00:33.462275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:35.317883 run osmo-stp_10.42.42.5(pid=20258): stderr: | 20221214070033658 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070033659 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070033659 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070033659 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070033660 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070033660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070033660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:35.475051 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20258): Process ended prematurely: osmo-stp_10.42.42.5(pid=20258) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20258)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:00:35.484394 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:00:35.512174 run osmo-hlr_10.42.42.2(pid=20255): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20255)] 07:00:35.562780 run osmo-hlr_10.42.42.2(pid=20255): stdout: | (launched: 2022-12-14_07:00:32.422959) 07:00:35.614900 run osmo-hlr_10.42.42.2(pid=20255): stderr: | 20221214070032623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070032623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070032623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070032623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070032623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070032623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070032639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070032648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070032648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070032648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:35.687087 run osmo-msc_10.42.42.6(pid=20261): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20261)] 07:00:35.737148 run osmo-msc_10.42.42.6(pid=20261): stdout: | (launched: 2022-12-14_07:00:34.522853) 07:00:35.789445 run osmo-msc_10.42.42.6(pid=20261): stderr: | 20221214070034849 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070034849 DLGLOBAL DEBUG validating counter group 0x7fb2f5c7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070034849 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070034849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070034849 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070034849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070034851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070034851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070034852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070034852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:35.841784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20254): Terminating (SIGTERM) 07:00:35.883388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20257): Terminating (SIGTERM) 07:00:35.925410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20260): Terminating (SIGTERM) 07:00:35.968070 --- ParallelTerminationStrategy: PID 20254 died... 07:00:35.988320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20254): Terminated: ok {rc=0} 07:00:36.034715 --- ParallelTerminationStrategy: PID 20257 died... 07:00:36.054486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20257): Terminated: ok {rc=0} 07:00:36.100708 --- ParallelTerminationStrategy: PID 20260 died... 07:00:36.120503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20260): Terminated: ok {rc=0} 07:00:36.207785 bus /sierra_3: Setting Powered False 07:00:37.306143 bus /sierra_3: Setting Powered False 07:00:38.424248 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:00:39.661327 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:00:39.668262 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:00:39.689544 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:00:39.717406 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:00:39.771408 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:00:39.793656 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:00:39.821214 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:00:40.367965 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:00:40.417346 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:40.428402 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:00:40.484073 tst mo_mt_call.py: using LAC 39204 07:00:40.606642 tst mo_mt_call.py: using RAC 189 07:00:40.728575 tst mo_mt_call.py: using CellId 39204 07:00:40.851630 tst mo_mt_call.py: using BVCI 39205 07:00:40.965096 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:40.976173 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:40.986976 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:40.997845 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:41.008648 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:41.019590 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:00:41.139911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:00:41.257140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:41.736041 run create_hlr_db(pid=20266): Launched 07:00:41.862370 bus /sierra_2: Setting Powered False 07:00:42.923999 run create_hlr_db(pid=20266): Terminated: ok {rc=0} 07:00:43.376583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20268): Launched 07:00:43.710406 run osmo-hlr_10.42.42.2(pid=20269): Launched 07:00:43.836166 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:44.412340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20271): Launched 07:00:44.745069 run osmo-stp_10.42.42.5(pid=20272): Launched 07:00:44.871153 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:45.468866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20274): Launched 07:00:45.802326 run osmo-msc_10.42.42.6(pid=20275): Launched 07:00:46.099238 run osmo-stp_10.42.42.5(pid=20272): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20272)] 07:00:46.309369 run osmo-stp_10.42.42.5(pid=20272): stdout: | (launched: 2022-12-14_07:00:44.682988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:46.643664 run osmo-stp_10.42.42.5(pid=20272): stderr: | 20221214070044877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070044877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070044877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070044877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070044878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070044878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070044878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:47.007316 run osmo-stp_10.42.42.5(pid=20272): stdout: | (launched: 2022-12-14_07:00:44.682988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:47.175079 run osmo-stp_10.42.42.5(pid=20272): stderr: | 20221214070044877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070044877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070044877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070044877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070044878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070044878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070044878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:47.337768 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20272): Process ended prematurely: osmo-stp_10.42.42.5(pid=20272) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20272)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:00:47.347549 tst mo_mt_call.py:8: Test FAILED (7.0 sec) 07:00:47.375744 run osmo-hlr_10.42.42.2(pid=20269): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20269)] 07:00:47.427792 run osmo-hlr_10.42.42.2(pid=20269): stdout: | (launched: 2022-12-14_07:00:43.648180) 07:00:47.479816 run osmo-hlr_10.42.42.2(pid=20269): stderr: | 20221214070043849 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070043849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070043849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070043849 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070043849 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070043849 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070043862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070043870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070043871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070043871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:47.552717 run osmo-msc_10.42.42.6(pid=20275): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20275)] 07:00:47.603165 run osmo-msc_10.42.42.6(pid=20275): stdout: | (launched: 2022-12-14_07:00:45.740126) 07:00:47.655042 run osmo-msc_10.42.42.6(pid=20275): stderr: | 20221214070046497 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070046498 DLGLOBAL DEBUG validating counter group 0x7f69f455ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070046499 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070046499 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070046502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070046503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070046512 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070046514 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070046515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070046515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:47.707659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20268): Terminating (SIGTERM) 07:00:47.749436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20271): Terminating (SIGTERM) 07:00:47.791440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20274): Terminating (SIGTERM) 07:00:47.833587 --- ParallelTerminationStrategy: PID 20268 died... 07:00:47.853432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20268): Terminated: ok {rc=0} 07:00:47.899872 --- ParallelTerminationStrategy: PID 20271 died... 07:00:47.919795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20271): Terminated: ok {rc=0} 07:00:47.966330 --- ParallelTerminationStrategy: PID 20274 died... 07:00:47.986201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20274): Terminated: ok {rc=0} 07:00:48.074973 bus /sierra_3: Setting Powered False 07:00:49.173987 bus /sierra_3: Setting Powered False 07:00:50.289378 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:00:51.434247 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:51.446120 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:00:51.506640 tst mo_mt_call_osmux.py: using LAC 39205 07:00:51.627218 tst mo_mt_call_osmux.py: using RAC 190 07:00:51.750018 tst mo_mt_call_osmux.py: using CellId 39205 07:00:51.870254 tst mo_mt_call_osmux.py: using BVCI 39206 07:00:51.984383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:51.995691 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:52.006700 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:52.017680 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:52.028586 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:00:52.039604 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:00:52.160609 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:00:52.280406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:52.759879 run create_hlr_db(pid=20280): Launched 07:00:52.885505 bus /sierra_2: Setting Powered False 07:00:53.946214 run create_hlr_db(pid=20280): Terminated: ok {rc=0} 07:00:54.399733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20282): Launched 07:00:54.732307 run osmo-hlr_10.42.42.2(pid=20283): Launched 07:00:54.858009 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:55.431610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20285): Launched 07:00:55.764262 run osmo-stp_10.42.42.5(pid=20286): Launched 07:00:55.888759 run osmo-msc_10.42.42.6: Starting osmo-msc 07:00:56.490892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20288): Launched 07:00:56.806267 run osmo-msc_10.42.42.6(pid=20289): Launched 07:00:56.976887 run osmo-stp_10.42.42.5(pid=20286): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20286)] 07:00:57.106120 run osmo-stp_10.42.42.5(pid=20286): stdout: | (launched: 2022-12-14_07:00:55.702423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:57.236306 run osmo-stp_10.42.42.5(pid=20286): stderr: | 20221214070055896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070055896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070055897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070055897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070055898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070055898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070055898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:57.364019 run osmo-stp_10.42.42.5(pid=20286): stdout: | (launched: 2022-12-14_07:00:55.702423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:57.485423 run osmo-stp_10.42.42.5(pid=20286): stderr: | 20221214070055896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070055896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070055897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070055897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070055898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070055898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070055898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:57.631151 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20286): Process ended prematurely: osmo-stp_10.42.42.5(pid=20286) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20286)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:00:57.639935 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:00:57.665961 run osmo-hlr_10.42.42.2(pid=20283): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20283)] 07:00:57.713109 run osmo-hlr_10.42.42.2(pid=20283): stdout: | (launched: 2022-12-14_07:00:54.670404) 07:00:57.761976 run osmo-hlr_10.42.42.2(pid=20283): stderr: | 20221214070054869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070054869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070054869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070054870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070054870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070054870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070054883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070054891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070054892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070054892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:57.830643 run osmo-msc_10.42.42.6(pid=20289): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20289)] 07:00:57.877972 run osmo-msc_10.42.42.6(pid=20289): stdout: | (launched: 2022-12-14_07:00:56.747520) 07:00:57.927025 run osmo-msc_10.42.42.6(pid=20289): stderr: | 20221214070057020 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070057021 DLGLOBAL DEBUG validating counter group 0x7f880d1cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070057021 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070057021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070057021 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070057021 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070057023 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070057023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070057023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070057023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:57.976344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20282): Terminating (SIGTERM) 07:00:58.015786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20285): Terminating (SIGTERM) 07:00:58.055339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20288): Terminating (SIGTERM) 07:00:58.095287 --- ParallelTerminationStrategy: PID 20282 died... 07:00:58.114235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20282): Terminated: ok {rc=0} 07:00:58.158132 --- ParallelTerminationStrategy: PID 20285 died... 07:00:58.176482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20285): Terminated: ok {rc=0} 07:00:58.220004 --- ParallelTerminationStrategy: PID 20288 died... 07:00:58.238471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20288): Terminated: ok {rc=0} 07:00:58.322165 bus /sierra_3: Setting Powered False 07:00:59.419864 bus /sierra_3: Setting Powered False 07:01:00.536299 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:01:01.778323 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:01:01.786427 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:01:01.808678 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:01:01.841153 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:01:01.898731 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:01:01.928136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:01:01.962987 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:01:02.494240 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:01:02.544010 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:02.555189 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:01:02.610997 tst mo_mt_call.py: using LAC 39206 07:01:02.734405 tst mo_mt_call.py: using RAC 191 07:01:02.856706 tst mo_mt_call.py: using CellId 39206 07:01:02.978405 tst mo_mt_call.py: using BVCI 39207 07:01:03.091098 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:03.102251 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:03.113254 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:03.124048 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:03.134861 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:03.145783 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:01:03.266966 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:01:03.385526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:03.865182 run create_hlr_db(pid=20294): Launched 07:01:03.990968 bus /sierra_2: Setting Powered False 07:01:05.051470 run create_hlr_db(pid=20294): Terminated: ok {rc=0} 07:01:05.502841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20296): Launched 07:01:05.836050 run osmo-hlr_10.42.42.2(pid=20297): Launched 07:01:05.962022 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:06.534385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20299): Launched 07:01:06.867202 run osmo-stp_10.42.42.5(pid=20300): Launched 07:01:06.993238 run osmo-msc_10.42.42.6: Starting osmo-msc 07:01:07.592539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20302): Launched 07:01:07.925096 run osmo-msc_10.42.42.6(pid=20303): Launched 07:01:08.108721 run osmo-stp_10.42.42.5(pid=20300): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20300)] 07:01:08.248114 run osmo-stp_10.42.42.5(pid=20300): stdout: | (launched: 2022-12-14_07:01:06.805164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:08.387866 run osmo-stp_10.42.42.5(pid=20300): stderr: | 20221214070107000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070107000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070107001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070107001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070107002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070107002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070107002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:08.527622 run osmo-stp_10.42.42.5(pid=20300): stdout: | (launched: 2022-12-14_07:01:06.805164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:08.659185 run osmo-stp_10.42.42.5(pid=20300): stderr: | 20221214070107000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070107000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070107001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070107001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070107002 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070107002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070107002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:08.816852 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20300): Process ended prematurely: osmo-stp_10.42.42.5(pid=20300) [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20300)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:01:08.826541 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:01:08.854136 run osmo-hlr_10.42.42.2(pid=20297): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20297)] 07:01:08.905084 run osmo-hlr_10.42.42.2(pid=20297): stdout: | (launched: 2022-12-14_07:01:05.773901) 07:01:08.957450 run osmo-hlr_10.42.42.2(pid=20297): stderr: | 20221214070105976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070105976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070105976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070105976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070105976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070105976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070105987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070105996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070105996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070105996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:09.029806 run osmo-msc_10.42.42.6(pid=20303): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20303)] 07:01:09.079479 run osmo-msc_10.42.42.6(pid=20303): stdout: | (launched: 2022-12-14_07:01:07.863079) 07:01:09.131643 run osmo-msc_10.42.42.6(pid=20303): stderr: | 20221214070108186 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070108187 DLGLOBAL DEBUG validating counter group 0x7f3353bf8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070108187 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070108187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070108187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070108187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070108189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070108189 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070108189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070108189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:01:09.184170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20296): Terminating (SIGTERM) 07:01:09.226004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20299): Terminating (SIGTERM) 07:01:09.268107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20302): Terminating (SIGTERM) 07:01:09.310620 --- ParallelTerminationStrategy: PID 20296 died... 07:01:09.331012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20296): Terminated: ok {rc=0} 07:01:09.377604 --- ParallelTerminationStrategy: PID 20299 died... 07:01:09.397444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20299): Terminated: ok {rc=0} 07:01:09.443767 --- ParallelTerminationStrategy: PID 20302 died... 07:01:09.463310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20302): Terminated: ok {rc=0} 07:01:09.552710 bus /sierra_3: Setting Powered False 07:01:10.651402 bus /sierra_3: Setting Powered False 07:01:11.770556 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:01:12.922312 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:12.934545 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:01:12.993308 tst mo_mt_call_osmux.py: using LAC 39207 07:01:13.123898 tst mo_mt_call_osmux.py: using RAC 192 07:01:13.255147 tst mo_mt_call_osmux.py: using CellId 39207 07:01:13.387021 tst mo_mt_call_osmux.py: using BVCI 39208 07:01:13.509770 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:13.521915 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:13.533505 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:13.544844 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:13.556719 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:01:13.568774 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:01:13.687417 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:01:13.810751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:14.292713 run create_hlr_db(pid=20305): Launched 07:01:14.420044 bus /sierra_2: Setting Powered False 07:01:15.480198 run create_hlr_db(pid=20305): Terminated: ok {rc=0} 07:01:15.945466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20307): Launched 07:01:16.273630 run osmo-hlr_10.42.42.2(pid=20308): Launched 07:01:16.539617 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:17.210647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20310): Launched 07:01:17.532580 run osmo-stp_10.42.42.5(pid=20311): Launched 07:01:17.648644 run osmo-msc_10.42.42.6: Starting osmo-msc 07:01:18.205520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20313): Launched 07:01:18.517884 run osmo-msc_10.42.42.6(pid=20314): Launched 07:01:18.689366 run osmo-stp_10.42.42.5(pid=20311): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20311)] 07:01:18.818808 run osmo-stp_10.42.42.5(pid=20311): stdout: | (launched: 2022-12-14_07:01:17.473995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:18.948378 run osmo-stp_10.42.42.5(pid=20311): stderr: | 20221214070117647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070117647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070117648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070117648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070117649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070117649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070117649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:19.075831 run osmo-stp_10.42.42.5(pid=20311): stdout: | (launched: 2022-12-14_07:01:17.473995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:19.197276 run osmo-stp_10.42.42.5(pid=20311): stderr: | 20221214070117647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070117647 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070117648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070117648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070117649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070117649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070117649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:19.342820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20311): Process ended prematurely: osmo-stp_10.42.42.5(pid=20311) [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20311)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:01:19.351578 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:01:19.377591 run osmo-hlr_10.42.42.2(pid=20308): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20308)] 07:01:19.425056 run osmo-hlr_10.42.42.2(pid=20308): stdout: | (launched: 2022-12-14_07:01:16.214350) 07:01:19.474192 run osmo-hlr_10.42.42.2(pid=20308): stderr: | 20221214070116506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070116506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070116506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070116506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070116506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070116506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070116523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070116535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070116536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070116536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:19.542800 run osmo-msc_10.42.42.6(pid=20314): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20314)] 07:01:19.590021 run osmo-msc_10.42.42.6(pid=20314): stdout: | (launched: 2022-12-14_07:01:18.458945) 07:01:19.639139 run osmo-msc_10.42.42.6(pid=20314): stderr: | 20221214070118733 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070118733 DLGLOBAL DEBUG validating counter group 0x7feee7728c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070118734 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070118734 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070118734 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070118734 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070118736 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070118736 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070118736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070118736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:01:19.688596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20307): Terminating (SIGTERM) 07:01:19.728023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20310): Terminating (SIGTERM) 07:01:19.767489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20313): Terminating (SIGTERM) 07:01:19.807099 --- ParallelTerminationStrategy: PID 20307 died... 07:01:19.826152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20307): Terminated: ok {rc=0} 07:01:19.869664 --- ParallelTerminationStrategy: PID 20310 died... 07:01:19.888084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20310): Terminated: ok {rc=0} 07:01:19.931292 --- ParallelTerminationStrategy: PID 20313 died... 07:01:19.949662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20313): Terminated: ok {rc=0} 07:01:20.034977 bus /sierra_3: Setting Powered False 07:01:21.135561 bus /sierra_3: Setting Powered False 07:01:22.247928 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:01:23.484875 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:01:23.491983 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:01:23.513593 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:01:23.542122 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:01:23.595508 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:01:23.616613 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:01:23.643887 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:01:24.194798 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:01:24.249515 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:24.261141 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:01:24.319229 tst mo_mt_call.py: using LAC 39208 07:01:24.451622 tst mo_mt_call.py: using RAC 193 07:01:24.582514 tst mo_mt_call.py: using CellId 39208 07:01:24.714788 tst mo_mt_call.py: using BVCI 39209 07:01:24.836213 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:24.847976 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:24.859466 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:24.870940 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:24.883399 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:24.895784 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:01:25.020463 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:01:25.143167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:25.658721 run create_hlr_db(pid=20319): Launched 07:01:25.785404 bus /sierra_2: Setting Powered False 07:01:26.850691 run create_hlr_db(pid=20319): Terminated: ok {rc=0} 07:01:27.293819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20321): Launched 07:01:27.604077 run osmo-hlr_10.42.42.2(pid=20322): Launched 07:01:27.720722 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:28.265566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20324): Launched 07:01:28.578428 run osmo-stp_10.42.42.5(pid=20325): Launched 07:01:28.694756 run osmo-msc_10.42.42.6: Starting osmo-msc 07:01:29.250135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20327): Launched 07:01:29.559669 run osmo-msc_10.42.42.6(pid=20328): Launched 07:01:29.730461 run osmo-stp_10.42.42.5(pid=20325): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20325)] 07:01:29.859568 run osmo-stp_10.42.42.5(pid=20325): stdout: | (launched: 2022-12-14_07:01:28.519749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:29.988805 run osmo-stp_10.42.42.5(pid=20325): stderr: | 20221214070128695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070128695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070128695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070128695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070128696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070128696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070128696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:30.116196 run osmo-stp_10.42.42.5(pid=20325): stdout: | (launched: 2022-12-14_07:01:28.519749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:30.237750 run osmo-stp_10.42.42.5(pid=20325): stderr: | 20221214070128695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070128695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070128695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070128695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070128696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070128696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070128696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:30.384061 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20325): Process ended prematurely: osmo-stp_10.42.42.5(pid=20325) [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20325)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:01:30.392848 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:01:30.419005 run osmo-hlr_10.42.42.2(pid=20322): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20322)] 07:01:30.466057 run osmo-hlr_10.42.42.2(pid=20322): stdout: | (launched: 2022-12-14_07:01:27.545700) 07:01:30.515043 run osmo-hlr_10.42.42.2(pid=20322): stderr: | 20221214070127726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070127726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070127726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070127726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070127726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070127726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070127739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070127749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070127750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070127750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:30.583300 run osmo-msc_10.42.42.6(pid=20328): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20328)] 07:01:30.630549 run osmo-msc_10.42.42.6(pid=20328): stdout: | (launched: 2022-12-14_07:01:29.501308) 07:01:30.679439 run osmo-msc_10.42.42.6(pid=20328): stderr: | 20221214070129776 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070129777 DLGLOBAL DEBUG validating counter group 0x7f7c2fe46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070129777 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070129777 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070129777 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070129777 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070129779 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070129779 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070129779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070129779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:01:30.728635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20321): Terminating (SIGTERM) 07:01:30.768186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20324): Terminating (SIGTERM) 07:01:30.807639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20327): Terminating (SIGTERM) 07:01:30.858561 --- ParallelTerminationStrategy: PID 20321 died... 07:01:30.882766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20321): Terminated: ok {rc=0} 07:01:30.935620 --- ParallelTerminationStrategy: PID 20324 died... 07:01:30.956736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20324): Terminated: ok {rc=0} 07:01:31.007389 --- ParallelTerminationStrategy: PID 20327 died... 07:01:31.028441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20327): Terminated: ok {rc=0} 07:01:31.125119 bus /sierra_3: Setting Powered False 07:01:32.223654 bus /sierra_3: Setting Powered False 07:01:33.339210 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:01:34.488367 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:34.500197 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:01:34.558105 tst mo_mt_call_osmux.py: using LAC 39209 07:01:34.679451 tst mo_mt_call_osmux.py: using RAC 194 07:01:34.811155 tst mo_mt_call_osmux.py: using CellId 39209 07:01:34.941980 tst mo_mt_call_osmux.py: using BVCI 39210 07:01:35.062925 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:35.074800 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:35.086438 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:35.097751 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:35.109392 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:01:35.121269 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:01:35.239542 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:01:35.364038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:35.878436 run create_hlr_db(pid=20330): Launched 07:01:36.004425 bus /sierra_2: Setting Powered False 07:01:37.069299 run create_hlr_db(pid=20330): Terminated: ok {rc=0} 07:01:37.511310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20332): Launched 07:01:37.819846 run osmo-hlr_10.42.42.2(pid=20333): Launched 07:01:37.935501 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:38.465367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20335): Launched 07:01:38.776545 run osmo-stp_10.42.42.5(pid=20336): Launched 07:01:38.894022 run osmo-msc_10.42.42.6: Starting osmo-msc 07:01:39.450077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20338): Launched 07:01:39.758971 run osmo-msc_10.42.42.6(pid=20339): Launched 07:01:39.929519 run osmo-stp_10.42.42.5(pid=20336): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20336)] 07:01:40.058923 run osmo-stp_10.42.42.5(pid=20336): stdout: | (launched: 2022-12-14_07:01:38.717895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:40.188112 run osmo-stp_10.42.42.5(pid=20336): stderr: | 20221214070138891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070138891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070138892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070138892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070138892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070138893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070138893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:40.315525 run osmo-stp_10.42.42.5(pid=20336): stdout: | (launched: 2022-12-14_07:01:38.717895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:40.436408 run osmo-stp_10.42.42.5(pid=20336): stderr: | 20221214070138891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070138891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070138892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070138892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070138892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070138893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070138893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:40.583135 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20336): Process ended prematurely: osmo-stp_10.42.42.5(pid=20336) [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20336)] [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:01:40.592182 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:01:40.618058 run osmo-hlr_10.42.42.2(pid=20333): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20333)] 07:01:40.664830 run osmo-hlr_10.42.42.2(pid=20333): stdout: | (launched: 2022-12-14_07:01:37.761901) 07:01:40.713550 run osmo-hlr_10.42.42.2(pid=20333): stderr: | 20221214070137939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070137939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070137939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070137940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070137940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070137940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070137952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070137961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070137961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070137961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:40.781336 run osmo-msc_10.42.42.6(pid=20339): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20339)] 07:01:40.828395 run osmo-msc_10.42.42.6(pid=20339): stdout: | (launched: 2022-12-14_07:01:39.700646) 07:01:40.877297 run osmo-msc_10.42.42.6(pid=20339): stderr: | 20221214070139974 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070139974 DLGLOBAL DEBUG validating counter group 0x7f39247a6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070139974 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070139974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070139974 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070139975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070139976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070139977 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070139977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070139977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:01:40.926219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20332): Terminating (SIGTERM) 07:01:40.965427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20335): Terminating (SIGTERM) 07:01:41.004708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20338): Terminating (SIGTERM) 07:01:41.044134 --- ParallelTerminationStrategy: PID 20332 died... 07:01:41.062967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20332): Terminated: ok {rc=0} 07:01:41.106409 --- ParallelTerminationStrategy: PID 20335 died... 07:01:41.124610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20335): Terminated: ok {rc=0} 07:01:41.167844 --- ParallelTerminationStrategy: PID 20338 died... 07:01:41.186062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20338): Terminated: ok {rc=0} 07:01:41.269198 bus /sierra_3: Setting Powered False 07:01:42.365679 bus /sierra_3: Setting Powered False 07:01:43.481396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:01:44.712824 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:01:44.719083 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:01:44.739623 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:01:44.766149 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:01:44.817316 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:01:44.838378 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:01:44.865037 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:01:45.416619 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:01:45.467459 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:45.478751 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:01:45.535308 tst mo_mt_call.py: using LAC 39210 07:01:45.659049 tst mo_mt_call.py: using RAC 195 07:01:45.781122 tst mo_mt_call.py: using CellId 39210 07:01:45.923140 tst mo_mt_call.py: using BVCI 39211 07:01:46.038505 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:46.050787 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:46.062876 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:46.074855 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:46.087118 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:46.099021 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:01:46.220639 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:01:46.337850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:46.829314 run create_hlr_db(pid=20344): Launched 07:01:46.991799 bus /sierra_2: Setting Powered False 07:01:48.053447 run create_hlr_db(pid=20344): Terminated: ok {rc=0} 07:01:48.485415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20346): Launched 07:01:48.799364 run osmo-hlr_10.42.42.2(pid=20347): Launched 07:01:48.915699 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:49.461856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20349): Launched 07:01:49.771399 run osmo-stp_10.42.42.5(pid=20350): Launched 07:01:49.887424 run osmo-msc_10.42.42.6: Starting osmo-msc 07:01:50.443442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20352): Launched 07:01:50.754241 run osmo-msc_10.42.42.6(pid=20353): Launched 07:01:50.925166 run osmo-stp_10.42.42.5(pid=20350): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20350)] 07:01:51.054346 run osmo-stp_10.42.42.5(pid=20350): stdout: | (launched: 2022-12-14_07:01:49.712749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:51.184309 run osmo-stp_10.42.42.5(pid=20350): stderr: | 20221214070149885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070149885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070149885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070149886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070149886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070149886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070149886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:51.312074 run osmo-stp_10.42.42.5(pid=20350): stdout: | (launched: 2022-12-14_07:01:49.712749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:51.433938 run osmo-stp_10.42.42.5(pid=20350): stderr: | 20221214070149885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070149885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070149885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070149886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070149886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070149886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070149886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:51.579986 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20350): Process ended prematurely: osmo-stp_10.42.42.5(pid=20350) [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20350)] [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:01:51.588924 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:01:51.614974 run osmo-hlr_10.42.42.2(pid=20347): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20347)] 07:01:51.662762 run osmo-hlr_10.42.42.2(pid=20347): stdout: | (launched: 2022-12-14_07:01:48.740362) 07:01:51.712071 run osmo-hlr_10.42.42.2(pid=20347): stderr: | 20221214070148919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070148919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070148919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070148919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070148919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070148919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070148932 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070148942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070148942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070148943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:51.780578 run osmo-msc_10.42.42.6(pid=20353): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20353)] 07:01:51.828086 run osmo-msc_10.42.42.6(pid=20353): stdout: | (launched: 2022-12-14_07:01:50.695953) 07:01:51.877291 run osmo-msc_10.42.42.6(pid=20353): stderr: | 20221214070150971 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070150971 DLGLOBAL DEBUG validating counter group 0x7fa9a62acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070150971 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070150971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070150971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070150971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070150975 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070150975 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070150975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070150975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:01:51.926664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20346): Terminating (SIGTERM) 07:01:51.966022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20349): Terminating (SIGTERM) 07:01:52.005655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20352): Terminating (SIGTERM) 07:01:52.045618 --- ParallelTerminationStrategy: PID 20346 died... 07:01:52.064502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20346): Terminated: ok {rc=0} 07:01:52.108399 --- ParallelTerminationStrategy: PID 20349 died... 07:01:52.126961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20349): Terminated: ok {rc=0} 07:01:52.170669 --- ParallelTerminationStrategy: PID 20352 died... 07:01:52.189320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20352): Terminated: ok {rc=0} 07:01:52.272356 bus /sierra_3: Setting Powered False 07:01:53.371310 bus /sierra_3: Setting Powered False 07:01:54.488708 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:01:55.640030 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:55.652386 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:01:55.710396 tst mo_mt_call_osmux.py: using LAC 39211 07:01:55.841285 tst mo_mt_call_osmux.py: using RAC 196 07:01:55.971797 tst mo_mt_call_osmux.py: using CellId 39211 07:01:56.103045 tst mo_mt_call_osmux.py: using BVCI 39212 07:01:56.224145 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:56.235904 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:56.247275 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:56.258749 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:56.270495 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:01:56.282366 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:01:56.401877 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:01:56.525648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:57.042447 run create_hlr_db(pid=20355): Launched 07:01:57.167913 bus /sierra_2: Setting Powered False 07:01:58.232432 run create_hlr_db(pid=20355): Terminated: ok {rc=0} 07:01:58.674867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20357): Launched 07:01:58.983821 run osmo-hlr_10.42.42.2(pid=20358): Launched 07:01:59.100297 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:59.630580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20360): Launched 07:01:59.939730 run osmo-stp_10.42.42.5(pid=20361): Launched 07:02:00.055536 run osmo-msc_10.42.42.6: Starting osmo-msc 07:02:00.610950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20363): Launched 07:02:00.930694 run osmo-msc_10.42.42.6(pid=20364): Launched 07:02:01.293634 run osmo-stp_10.42.42.5(pid=20361): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20361)] 07:02:01.491170 run osmo-stp_10.42.42.5(pid=20361): stdout: | (launched: 2022-12-14_07:01:59.881411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:01.657986 run osmo-stp_10.42.42.5(pid=20361): stderr: | 20221214070200053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070200054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070200054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070200054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070200055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070200055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070200055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:01.801221 run osmo-stp_10.42.42.5(pid=20361): stdout: | (launched: 2022-12-14_07:01:59.881411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:01.937764 run osmo-stp_10.42.42.5(pid=20361): stderr: | 20221214070200053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070200054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070200054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070200054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070200055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070200055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070200055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:02.099849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20361): Process ended prematurely: osmo-stp_10.42.42.5(pid=20361) [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20361)] [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:02:02.111477 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:02:02.141074 run osmo-hlr_10.42.42.2(pid=20358): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20358)] 07:02:02.195711 run osmo-hlr_10.42.42.2(pid=20358): stdout: | (launched: 2022-12-14_07:01:58.925760) 07:02:02.250284 run osmo-hlr_10.42.42.2(pid=20358): stderr: | 20221214070159103 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070159103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070159103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070159103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070159103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070159103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070159119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070159130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070159130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070159130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:02.326912 run osmo-msc_10.42.42.6(pid=20364): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20364)] 07:02:02.378395 run osmo-msc_10.42.42.6(pid=20364): stdout: | (launched: 2022-12-14_07:02:00.863009) 07:02:02.430892 run osmo-msc_10.42.42.6(pid=20364): stderr: | 20221214070201254 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070201254 DLGLOBAL DEBUG validating counter group 0x7fc9cf0ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070201254 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070201254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070201255 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070201255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070201259 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070201260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070201260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070201260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:02:02.483357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20357): Terminating (SIGTERM) 07:02:02.525779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20360): Terminating (SIGTERM) 07:02:02.568518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20363): Terminating (SIGTERM) 07:02:02.611209 --- ParallelTerminationStrategy: PID 20357 died... 07:02:02.631686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20357): Terminated: ok {rc=0} 07:02:02.678698 --- ParallelTerminationStrategy: PID 20360 died... 07:02:02.698685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20360): Terminated: ok {rc=0} 07:02:02.745342 --- ParallelTerminationStrategy: PID 20363 died... 07:02:02.765333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20363): Terminated: ok {rc=0} 07:02:02.853250 bus /sierra_3: Setting Powered False 07:02:03.949500 bus /sierra_3: Setting Powered False 07:02:05.064293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:02:06.302629 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:02:06.308795 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:02:06.330226 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:02:06.358744 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:02:06.409669 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:02:06.431152 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:02:06.458723 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:02:07.009302 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:02:07.063852 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:07.075466 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:02:07.133428 tst mo_mt_call.py: using LAC 39212 07:02:07.253314 tst mo_mt_call.py: using RAC 197 07:02:07.372898 tst mo_mt_call.py: using CellId 39212 07:02:07.493580 tst mo_mt_call.py: using BVCI 39213 07:02:07.607025 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:07.618158 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:07.628911 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:07.639573 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:07.650310 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:07.661047 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:02:07.784083 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:02:07.909191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:08.423368 run create_hlr_db(pid=20369): Launched 07:02:08.549833 bus /sierra_2: Setting Powered False 07:02:09.610675 run create_hlr_db(pid=20369): Terminated: ok {rc=0} 07:02:10.055229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20371): Launched 07:02:10.365538 run osmo-hlr_10.42.42.2(pid=20372): Launched 07:02:10.483784 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:11.021713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20374): Launched 07:02:11.332233 run osmo-stp_10.42.42.5(pid=20375): Launched 07:02:11.449740 run osmo-msc_10.42.42.6: Starting osmo-msc 07:02:12.008401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20377): Launched 07:02:12.319242 run osmo-msc_10.42.42.6(pid=20378): Launched 07:02:12.490515 run osmo-stp_10.42.42.5(pid=20375): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20375)] 07:02:12.625654 run osmo-stp_10.42.42.5(pid=20375): stdout: | (launched: 2022-12-14_07:02:11.273308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:12.755979 run osmo-stp_10.42.42.5(pid=20375): stderr: | 20221214070211446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070211446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070211447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070211447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070211447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070211447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070211448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:12.884154 run osmo-stp_10.42.42.5(pid=20375): stdout: | (launched: 2022-12-14_07:02:11.273308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:13.005828 run osmo-stp_10.42.42.5(pid=20375): stderr: | 20221214070211446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070211446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070211447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070211447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070211447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070211447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070211448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:13.152175 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20375): Process ended prematurely: osmo-stp_10.42.42.5(pid=20375) [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20375)] [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:02:13.161161 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:02:13.187207 run osmo-hlr_10.42.42.2(pid=20372): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20372)] 07:02:13.234709 run osmo-hlr_10.42.42.2(pid=20372): stdout: | (launched: 2022-12-14_07:02:10.307110) 07:02:13.283666 run osmo-hlr_10.42.42.2(pid=20372): stderr: | 20221214070210487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070210487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070210487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070210487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070210487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070210487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070210527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070210536 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070210536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070210536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:13.352519 run osmo-msc_10.42.42.6(pid=20378): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20378)] 07:02:13.399827 run osmo-msc_10.42.42.6(pid=20378): stdout: | (launched: 2022-12-14_07:02:12.260208) 07:02:13.448939 run osmo-msc_10.42.42.6(pid=20378): stderr: | 20221214070212537 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070212537 DLGLOBAL DEBUG validating counter group 0x7fee4e0b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070212537 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070212537 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070212538 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070212538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070212539 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070212540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070212540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070212540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:02:13.498070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20371): Terminating (SIGTERM) 07:02:13.537513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20374): Terminating (SIGTERM) 07:02:13.576900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20377): Terminating (SIGTERM) 07:02:13.616727 --- ParallelTerminationStrategy: PID 20371 died... 07:02:13.635961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20371): Terminated: ok {rc=0} 07:02:13.680095 --- ParallelTerminationStrategy: PID 20374 died... 07:02:13.698696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20374): Terminated: ok {rc=0} 07:02:13.742150 --- ParallelTerminationStrategy: PID 20377 died... 07:02:13.760782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20377): Terminated: ok {rc=0} 07:02:13.843988 bus /sierra_3: Setting Powered False 07:02:14.941593 bus /sierra_3: Setting Powered False 07:02:16.077918 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:02:17.242826 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:17.255792 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:02:17.321708 tst mo_mt_call_osmux.py: using LAC 39213 07:02:17.451548 tst mo_mt_call_osmux.py: using RAC 198 07:02:17.580912 tst mo_mt_call_osmux.py: using CellId 39213 07:02:17.710655 tst mo_mt_call_osmux.py: using BVCI 39214 07:02:17.833488 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:17.845134 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:17.856393 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:17.867754 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:17.879336 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:02:17.891166 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:02:18.009347 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:02:18.131593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:18.646690 run create_hlr_db(pid=20380): Launched 07:02:18.772502 bus /sierra_2: Setting Powered False 07:02:19.837497 run create_hlr_db(pid=20380): Terminated: ok {rc=0} 07:02:20.279454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20382): Launched 07:02:20.590056 run osmo-hlr_10.42.42.2(pid=20383): Launched 07:02:20.706524 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:21.236562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20385): Launched 07:02:21.545905 run osmo-stp_10.42.42.5(pid=20386): Launched 07:02:21.662563 run osmo-msc_10.42.42.6: Starting osmo-msc 07:02:22.218183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20388): Launched 07:02:22.527256 run osmo-msc_10.42.42.6(pid=20389): Launched 07:02:22.698576 run osmo-stp_10.42.42.5(pid=20386): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20386)] 07:02:22.832237 run osmo-stp_10.42.42.5(pid=20386): stdout: | (launched: 2022-12-14_07:02:21.487758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:22.961791 run osmo-stp_10.42.42.5(pid=20386): stderr: | 20221214070221662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070221662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070221663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070221663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070221664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070221664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070221664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:23.089168 run osmo-stp_10.42.42.5(pid=20386): stdout: | (launched: 2022-12-14_07:02:21.487758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:23.210757 run osmo-stp_10.42.42.5(pid=20386): stderr: | 20221214070221662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070221662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070221663 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070221663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070221664 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070221664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070221664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:23.357091 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20386): Process ended prematurely: osmo-stp_10.42.42.5(pid=20386) [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20386)] [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:02:23.365935 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:02:23.391902 run osmo-hlr_10.42.42.2(pid=20383): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20383)] 07:02:23.439610 run osmo-hlr_10.42.42.2(pid=20383): stdout: | (launched: 2022-12-14_07:02:20.531244) 07:02:23.489079 run osmo-hlr_10.42.42.2(pid=20383): stderr: | 20221214070220713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070220713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070220713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070220713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070220713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070220713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070220727 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070220737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070220737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070220737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:23.557612 run osmo-msc_10.42.42.6(pid=20389): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20389)] 07:02:23.604899 run osmo-msc_10.42.42.6(pid=20389): stdout: | (launched: 2022-12-14_07:02:22.468722) 07:02:23.653966 run osmo-msc_10.42.42.6(pid=20389): stderr: | 20221214070222745 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070222745 DLGLOBAL DEBUG validating counter group 0x7fa6ff3ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070222745 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070222745 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070222745 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070222746 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070222747 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070222748 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070222748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070222748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:02:23.703557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20382): Terminating (SIGTERM) 07:02:23.743239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20385): Terminating (SIGTERM) 07:02:23.782765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20388): Terminating (SIGTERM) 07:02:23.822490 --- ParallelTerminationStrategy: PID 20382 died... 07:02:23.841622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20382): Terminated: ok {rc=0} 07:02:23.885408 --- ParallelTerminationStrategy: PID 20385 died... 07:02:23.903919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20385): Terminated: ok {rc=0} 07:02:23.947534 --- ParallelTerminationStrategy: PID 20388 died... 07:02:23.966130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20388): Terminated: ok {rc=0} 07:02:24.052242 bus /sierra_3: Setting Powered False 07:02:25.151904 bus /sierra_3: Setting Powered False 07:02:26.267432 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 emergency:sysmo --------------------------------------------------------------------- 07:02:27.498223 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:02:27.502416 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 07:02:27.522996 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 07:02:27.549554 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 07:02:27.634632 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 07:02:27.655753 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 07:02:27.682192 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 07:02:28.262563 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2401 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 07:02:28.267738 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:28.278527 tst emergency:sysmo: Using 1 x bts (candidates: 1) 07:02:28.317282 tst emergency_mo_mt_call.py: using LAC 39214 07:02:28.436627 tst emergency_mo_mt_call.py: using RAC 199 07:02:28.558714 tst emergency_mo_mt_call.py: using CellId 39214 07:02:28.680297 tst emergency_mo_mt_call.py: using BVCI 39215 07:02:28.790742 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:28.801395 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:28.811917 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:28.822376 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:28.832749 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:28.843614 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:02:28.960878 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:02:29.082410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:29.554925 run create_hlr_db(pid=20394): Launched 07:02:29.679438 bus /sierra_2: Setting Powered False 07:02:30.739644 run create_hlr_db(pid=20394): Terminated: ok {rc=0} 07:02:31.217760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20396): Launched 07:02:31.566731 run osmo-hlr_10.42.42.2(pid=20397): Launched 07:02:31.817056 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:32.460481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20400): Launched 07:02:32.788398 run osmo-stp_10.42.42.5(pid=20401): Launched 07:02:32.927357 tst emergency_mo_mt_call.py: using MSISDN 8560 07:02:33.103082 run osmo-msc_10.42.42.6: Starting osmo-msc 07:02:33.690752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20403): Launched 07:02:34.016656 run osmo-msc_10.42.42.6(pid=20404): Launched 07:02:34.198221 run osmo-stp_10.42.42.5(pid=20401): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20401)] 07:02:34.334998 run osmo-stp_10.42.42.5(pid=20401): stdout: | (launched: 2022-12-14_07:02:32.727339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:34.472703 run osmo-stp_10.42.42.5(pid=20401): stderr: | 20221214070232924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070232924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070232925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070232925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070232926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070232926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070232926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:34.610223 run osmo-stp_10.42.42.5(pid=20401): stdout: | (launched: 2022-12-14_07:02:32.727339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:34.739797 run osmo-stp_10.42.42.5(pid=20401): stderr: | 20221214070232924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070232924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070232925 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070232925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070232926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070232926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070232926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:34.894920 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=20401): Process ended prematurely: osmo-stp_10.42.42.5(pid=20401) [trial-2401↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20401)] [trial-2401↪emergency:sysmo↪emergency_mo_mt_call.py:19] 07:02:34.903853 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 07:02:34.931595 run osmo-hlr_10.42.42.2(pid=20397): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20397)] 07:02:34.982736 run osmo-hlr_10.42.42.2(pid=20397): stdout: | (launched: 2022-12-14_07:02:31.502079) 07:02:35.035542 run osmo-hlr_10.42.42.2(pid=20397): stderr: | 20221214070231806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070231806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070231806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070231806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070231806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070231806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070231818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070231835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070231835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070231835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:35.108722 run osmo-msc_10.42.42.6(pid=20404): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20404)] 07:02:35.159186 run osmo-msc_10.42.42.6(pid=20404): stdout: | (launched: 2022-12-14_07:02:33.955447) 07:02:35.211727 run osmo-msc_10.42.42.6(pid=20404): stderr: | 20221214070234280 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070234280 DLGLOBAL DEBUG validating counter group 0x7fda7efb9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070234280 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070234280 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070234280 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070234281 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070234282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070234283 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070234283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070234283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:02:35.264510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20396): Terminating (SIGTERM) 07:02:35.306681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20400): Terminating (SIGTERM) 07:02:35.349345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20403): Terminating (SIGTERM) 07:02:35.391997 --- ParallelTerminationStrategy: PID 20396 died... 07:02:35.412607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20396): Terminated: ok {rc=0} 07:02:35.459588 --- ParallelTerminationStrategy: PID 20400 died... 07:02:35.479617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20400): Terminated: ok {rc=0} 07:02:35.526084 --- ParallelTerminationStrategy: PID 20403 died... 07:02:35.546078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20403): Terminated: ok {rc=0} 07:02:35.634948 bus /sierra_3: Setting Powered False 07:02:36.734586 bus /sierra_3: Setting Powered False 07:02:37.850268 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 07:02:38.937543 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:38.949664 tst emergency:sysmo: Using 1 x bts (candidates: 1) 07:02:38.989301 tst emergency_preemptive_call.py: using LAC 39215 07:02:39.118900 tst emergency_preemptive_call.py: using RAC 200 07:02:39.247745 tst emergency_preemptive_call.py: using CellId 39215 07:02:39.377341 tst emergency_preemptive_call.py: using BVCI 39216 07:02:39.495031 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:39.506496 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:39.517641 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:39.528655 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:39.540006 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 07:02:39.551198 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:02:39.672795 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:02:39.792060 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:02:39.907203 tst emergency:sysmo: Using 1 x modem (candidates: 4) 07:02:40.020763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:40.490925 run create_hlr_db(pid=20406): Launched 07:02:40.614341 bus /sierra_2: Setting Powered False 07:02:41.675303 run create_hlr_db(pid=20406): Terminated: ok {rc=0} 07:02:42.097480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20408): Launched 07:02:42.404577 run osmo-hlr_10.42.42.2(pid=20409): Launched 07:02:42.518875 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:43.044894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20411): Launched 07:02:43.349463 run osmo-stp_10.42.42.5(pid=20412): Launched 07:02:43.475136 tst emergency_preemptive_call.py: using MSISDN 8561 07:02:43.630916 run osmo-msc_10.42.42.6: Starting osmo-msc 07:02:44.178402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20414): Launched 07:02:44.481539 run osmo-msc_10.42.42.6(pid=20415): Launched 07:02:44.657612 run osmo-stp_10.42.42.5(pid=20412): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20412)] 07:02:44.785623 run osmo-stp_10.42.42.5(pid=20412): stdout: | (launched: 2022-12-14_07:02:43.291635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:44.913964 run osmo-stp_10.42.42.5(pid=20412): stderr: | 20221214070243464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070243464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070243464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070243465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070243465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070243466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070243466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:45.040423 run osmo-stp_10.42.42.5(pid=20412): stdout: | (launched: 2022-12-14_07:02:43.291635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:45.160772 run osmo-stp_10.42.42.5(pid=20412): stderr: | 20221214070243464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070243464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070243464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070243465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070243465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070243466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070243466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:45.305202 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=20412): Process ended prematurely: osmo-stp_10.42.42.5(pid=20412) [trial-2401↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20412)] [trial-2401↪emergency:sysmo↪emergency_preemptive_call.py:32] 07:02:45.313273 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 07:02:45.338900 run osmo-hlr_10.42.42.2(pid=20409): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20409)] 07:02:45.386546 run osmo-hlr_10.42.42.2(pid=20409): stdout: | (launched: 2022-12-14_07:02:42.346285) 07:02:45.435577 run osmo-hlr_10.42.42.2(pid=20409): stderr: | 20221214070242527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070242527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070242527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070242527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070242527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070242527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070242539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070242550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070242550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070242550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:45.504133 run osmo-msc_10.42.42.6(pid=20415): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20415)] 07:02:45.551676 run osmo-msc_10.42.42.6(pid=20415): stdout: | (launched: 2022-12-14_07:02:44.423882) 07:02:45.600853 run osmo-msc_10.42.42.6(pid=20415): stderr: | 20221214070244698 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070244698 DLGLOBAL DEBUG validating counter group 0x7fedb7d5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070244698 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070244698 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070244698 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070244699 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070244700 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070244701 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070244701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070244701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:02:45.650158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20408): Terminating (SIGTERM) 07:02:45.689671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20411): Terminating (SIGTERM) 07:02:45.729284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20414): Terminating (SIGTERM) 07:02:45.769140 --- ParallelTerminationStrategy: PID 20408 died... 07:02:45.787682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20408): Terminated: ok {rc=0} 07:02:45.831675 --- ParallelTerminationStrategy: PID 20411 died... 07:02:45.850744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20411): Terminated: ok {rc=0} 07:02:45.896050 --- ParallelTerminationStrategy: PID 20414 died... 07:02:45.915730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20414): Terminated: ok {rc=0} 07:02:46.007361 bus /sierra_9: Setting Powered False 07:02:47.134620 bus /sierra_9: Setting Powered False 07:02:48.259140 bus /sierra_8: Setting Powered False 07:02:49.357625 bus /sierra_8: Setting Powered False 07:02:50.473564 bus /sierra_3: Setting Powered False 07:02:51.571162 bus /sierra_3: Setting Powered False 07:02:52.688499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:sysmo --------------------------------------------------------------------- 07:02:53.951896 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:02:53.956436 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 07:02:53.977776 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 07:02:54.018482 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 07:02:54.105440 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 07:02:54.126559 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 07:02:54.165743 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 07:02:54.756901 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 07:02:54.811727 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:02:54.822744 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:02:54.857146 tst cs_paging_gprs_active.py: using LAC 39216 07:02:54.986400 tst cs_paging_gprs_active.py: using RAC 201 07:02:55.120246 tst cs_paging_gprs_active.py: using CellId 39216 07:02:55.243374 tst cs_paging_gprs_active.py: using BVCI 39217 07:02:55.357360 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:02:55.367948 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:02:55.378562 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:02:55.389214 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:02:55.400180 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:02:55.411401 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:02:55.422590 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:02:55.433735 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:02:55.444884 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:02:55.567721 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:02:55.690025 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:02:55.915178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:56.250014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20421): Launched 07:02:56.545668 run iperf3-srv_10.42.42.10(pid=20422): Launched 07:02:56.673085 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:02:56.898864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:57.236394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20423): Launched 07:02:57.526111 run iperf3-srv_10.42.42.10(pid=20424): Launched 07:02:57.651224 tst cs_paging_gprs_active.py:38: start network... 07:02:57.875242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:58.391193 run create_hlr_db(pid=20425): Launched 07:02:58.517960 bus /sierra_2: Setting Powered False 07:02:59.583171 run create_hlr_db(pid=20425): Terminated: ok {rc=0} 07:03:00.045930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20427): Launched 07:03:00.380307 run osmo-hlr_10.42.42.2(pid=20428): Launched 07:03:00.507034 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:01.106330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20430): Launched 07:03:01.480890 run osmo-stp_10.42.42.5(pid=20432): Launched 07:03:01.754648 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:03.280468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20434): Launched 07:03:03.398102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:03.662994 run patchelf(pid=20435): Launched 07:03:03.836440 run osmo-stp_10.42.42.5(pid=20432): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20432)] 07:03:03.966871 run osmo-stp_10.42.42.5(pid=20432): stdout: | (launched: 2022-12-14_07:03:01.417867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:04.098003 run osmo-stp_10.42.42.5(pid=20432): stderr: | 20221214070301650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070301651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070301651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070301651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070301652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070301652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070301652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:04.229528 run osmo-stp_10.42.42.5(pid=20432): stdout: | (launched: 2022-12-14_07:03:01.417867) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:04.355601 run osmo-stp_10.42.42.5(pid=20432): stderr: | 20221214070301650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070301651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070301651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070301651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070301652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070301652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070301652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:04.504652 run patchelf(pid=20435): Terminating (SIGINT) 07:03:04.679593 run patchelf(pid=20435): Terminated: ok {rc=0} 07:03:04.805432 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20432): Process ended prematurely: osmo-stp_10.42.42.5(pid=20432) [trial-2401↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20432)] [trial-2401↪gprs:sysmo↪cs_paging_gprs_active.py:38] 07:03:04.814692 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 07:03:04.841561 run osmo-hlr_10.42.42.2(pid=20428): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20428)] 07:03:04.888724 run osmo-hlr_10.42.42.2(pid=20428): stdout: | (launched: 2022-12-14_07:03:00.317984) 07:03:04.937683 run osmo-hlr_10.42.42.2(pid=20428): stderr: | 20221214070300521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070300521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070300521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070300521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070300521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070300521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070300534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070300542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070300542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070300542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:04.987010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20421): Terminating (SIGTERM) 07:03:05.026647 run iperf3-srv_10.42.42.10(pid=20422): Terminating (SIGTERM) 07:03:05.066189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20423): Terminating (SIGTERM) 07:03:05.105745 run iperf3-srv_10.42.42.10(pid=20424): Terminating (SIGTERM) 07:03:05.145528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20427): Terminating (SIGTERM) 07:03:05.185571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20430): Terminating (SIGTERM) 07:03:05.225268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20434): Terminating (SIGTERM) 07:03:05.265738 --- ParallelTerminationStrategy: PID 20421 died... 07:03:05.284894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20421): Terminated: ok {rc=0} 07:03:05.329105 --- ParallelTerminationStrategy: PID 20422 died... 07:03:05.347714 run iperf3-srv_10.42.42.10(pid=20422): Terminated {rc=256} 07:03:05.391406 --- ParallelTerminationStrategy: PID 20423 died... 07:03:05.410175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20423): Terminated: ok {rc=0} 07:03:05.453836 --- ParallelTerminationStrategy: PID 20424 died... 07:03:05.472574 run iperf3-srv_10.42.42.10(pid=20424): Terminated {rc=256} 07:03:05.516430 --- ParallelTerminationStrategy: PID 20427 died... 07:03:05.535329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20427): Terminated: ok {rc=0} 07:03:05.579958 --- ParallelTerminationStrategy: PID 20430 died... 07:03:05.598669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20430): Terminated: ok {rc=0} 07:03:05.642558 --- ParallelTerminationStrategy: PID 20434 died... 07:03:05.661270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20434): Terminated: ok {rc=0} 07:03:05.747186 bus /gobi_0: Setting Powered False 07:03:06.846600 bus /gobi_0: Setting Powered False 07:03:07.962126 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo iperf3.py ---------------------------------------------- 07:03:09.114253 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:09.126212 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:03:09.165422 tst iperf3.py: using LAC 39217 07:03:09.296237 tst iperf3.py: using RAC 202 07:03:09.417297 tst iperf3.py: using CellId 39217 07:03:09.538529 tst iperf3.py: using BVCI 39218 07:03:09.651415 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:09.662133 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:09.672749 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:09.683285 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:09.693518 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:09.703777 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:09.714215 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:09.725165 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:09.735645 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:03:09.855633 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:03:10.079832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:10.414614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20436): Launched 07:03:10.704808 run iperf3-srv_10.42.42.10(pid=20437): Launched 07:03:10.828330 tst iperf3.py:8: start network... 07:03:11.051150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:11.564509 run create_hlr_db(pid=20438): Launched 07:03:11.690820 bus /gobi_6: Setting Powered False 07:03:12.755170 run create_hlr_db(pid=20438): Terminated: ok {rc=0} 07:03:13.196522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20440): Launched 07:03:13.506721 run osmo-hlr_10.42.42.2(pid=20441): Launched 07:03:13.624504 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:14.160123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20443): Launched 07:03:14.469305 run osmo-stp_10.42.42.5(pid=20444): Launched 07:03:14.588717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:15.122797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20446): Launched 07:03:15.241481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:15.503437 run patchelf(pid=20447): Launched 07:03:15.674543 run osmo-stp_10.42.42.5(pid=20444): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20444)] 07:03:15.803794 run osmo-stp_10.42.42.5(pid=20444): stdout: | (launched: 2022-12-14_07:03:14.409883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:15.959146 run osmo-stp_10.42.42.5(pid=20444): stderr: | 20221214070314585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070314585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070314585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070314586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070314586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070314586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070314586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:16.093855 run osmo-stp_10.42.42.5(pid=20444): stdout: | (launched: 2022-12-14_07:03:14.409883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:16.221323 run osmo-stp_10.42.42.5(pid=20444): stderr: | 20221214070314585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070314585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070314585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070314586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070314586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070314586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070314586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:16.372705 run patchelf(pid=20447): Terminating (SIGINT) 07:03:16.549305 run patchelf(pid=20447): Terminated: ok {rc=0} 07:03:16.678110 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20444): Process ended prematurely: osmo-stp_10.42.42.5(pid=20444) [trial-2401↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20444)] [trial-2401↪gprs:sysmo↪iperf3.py:8] 07:03:16.688520 tst iperf3.py:8: Test FAILED (7.6 sec) 07:03:16.716540 run osmo-hlr_10.42.42.2(pid=20441): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20441)] 07:03:16.765039 run osmo-hlr_10.42.42.2(pid=20441): stdout: | (launched: 2022-12-14_07:03:13.448169) 07:03:16.815436 run osmo-hlr_10.42.42.2(pid=20441): stderr: | 20221214070313647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070313647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070313647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070313647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070313647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070313647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070313660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070313670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070313670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070313670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:16.866222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20436): Terminating (SIGTERM) 07:03:16.907280 run iperf3-srv_10.42.42.10(pid=20437): Terminating (SIGTERM) 07:03:16.951148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20440): Terminating (SIGTERM) 07:03:16.993083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20443): Terminating (SIGTERM) 07:03:17.036067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20446): Terminating (SIGTERM) 07:03:17.079128 --- ParallelTerminationStrategy: PID 20436 died... 07:03:17.099159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20436): Terminated: ok {rc=0} 07:03:17.145260 --- ParallelTerminationStrategy: PID 20437 died... 07:03:17.164517 run iperf3-srv_10.42.42.10(pid=20437): Terminated {rc=256} 07:03:17.208753 --- ParallelTerminationStrategy: PID 20440 died... 07:03:17.228163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20440): Terminated: ok {rc=0} 07:03:17.272030 --- ParallelTerminationStrategy: PID 20443 died... 07:03:17.290738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20443): Terminated: ok {rc=0} 07:03:17.334237 --- ParallelTerminationStrategy: PID 20446 died... 07:03:17.352841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20446): Terminated: ok {rc=0} 07:03:17.438703 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo iperf3m4.py ---------------------------------------------- 07:03:18.586763 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:18.598167 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:03:18.634985 tst iperf3m4.py: using LAC 39218 07:03:18.757636 tst iperf3m4.py: using RAC 203 07:03:18.881390 tst iperf3m4.py: using CellId 39218 07:03:19.002832 tst iperf3m4.py: using BVCI 39219 07:03:19.117296 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:19.127802 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:19.138314 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:19.148690 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:19.159164 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:19.169649 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:19.180329 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:19.190919 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:19.201564 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:03:19.323602 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:03:19.448648 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:03:19.568613 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:03:19.687562 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:03:19.894162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:20.205632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20448): Launched 07:03:20.478141 run iperf3-srv_10.42.42.10(pid=20449): Launched 07:03:20.593896 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:03:20.800324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:21.111864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20450): Launched 07:03:21.382968 run iperf3-srv_10.42.42.10(pid=20451): Launched 07:03:21.498466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:03:21.704912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:22.015652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20452): Launched 07:03:22.285483 run iperf3-srv_10.42.42.10(pid=20453): Launched 07:03:22.401548 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:03:22.609093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:22.922949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20454): Launched 07:03:23.207096 run iperf3-srv_10.42.42.10(pid=20455): Launched 07:03:23.332466 tst iperf3m4.py:8: start network... 07:03:23.556266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:24.072457 run create_hlr_db(pid=20456): Launched 07:03:24.198352 bus /gobi_6: Setting Powered False 07:03:25.264095 run create_hlr_db(pid=20456): Terminated: ok {rc=0} 07:03:25.726981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20458): Launched 07:03:26.059622 run osmo-hlr_10.42.42.2(pid=20459): Launched 07:03:26.186432 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:26.760440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20461): Launched 07:03:27.093182 run osmo-stp_10.42.42.5(pid=20462): Launched 07:03:27.219325 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:27.790794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20464): Launched 07:03:27.919547 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:28.200896 run patchelf(pid=20465): Launched 07:03:28.385436 run osmo-stp_10.42.42.5(pid=20462): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20462)] 07:03:28.525385 run osmo-stp_10.42.42.5(pid=20462): stdout: | (launched: 2022-12-14_07:03:27.030893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:28.667552 run osmo-stp_10.42.42.5(pid=20462): stderr: | 20221214070327227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070327228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070327228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070327228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070327229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070327229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070327229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:28.809090 run osmo-stp_10.42.42.5(pid=20462): stdout: | (launched: 2022-12-14_07:03:27.030893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:28.944167 run osmo-stp_10.42.42.5(pid=20462): stderr: | 20221214070327227 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070327228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070327228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070327228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070327229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070327229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070327229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:29.104813 run patchelf(pid=20465): Terminating (SIGINT) 07:03:29.291437 run patchelf(pid=20465): Terminated: ok {rc=0} 07:03:29.426385 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20462): Process ended prematurely: osmo-stp_10.42.42.5(pid=20462) [trial-2401↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20462)] [trial-2401↪gprs:sysmo↪iperf3m4.py:8] 07:03:29.436415 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:03:29.465279 run osmo-hlr_10.42.42.2(pid=20459): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20459)] 07:03:29.516327 run osmo-hlr_10.42.42.2(pid=20459): stdout: | (launched: 2022-12-14_07:03:25.997341) 07:03:29.568831 run osmo-hlr_10.42.42.2(pid=20459): stderr: | 20221214070326198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070326198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070326198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070326198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070326198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070326199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070326211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070326219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070326219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070326219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:29.621932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20448): Terminating (SIGTERM) 07:03:29.664018 run iperf3-srv_10.42.42.10(pid=20449): Terminating (SIGTERM) 07:03:29.706428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20450): Terminating (SIGTERM) 07:03:29.748818 run iperf3-srv_10.42.42.10(pid=20451): Terminating (SIGTERM) 07:03:29.790999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20452): Terminating (SIGTERM) 07:03:29.833448 run iperf3-srv_10.42.42.10(pid=20453): Terminating (SIGTERM) 07:03:29.875796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20454): Terminating (SIGTERM) 07:03:29.918153 run iperf3-srv_10.42.42.10(pid=20455): Terminating (SIGTERM) 07:03:29.960231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20458): Terminating (SIGTERM) 07:03:30.003051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20461): Terminating (SIGTERM) 07:03:30.045319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20464): Terminating (SIGTERM) 07:03:30.087710 --- ParallelTerminationStrategy: PID 20448 died... 07:03:30.108135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20448): Terminated: ok {rc=0} 07:03:30.154874 --- ParallelTerminationStrategy: PID 20449 died... 07:03:30.174709 run iperf3-srv_10.42.42.10(pid=20449): Terminated {rc=256} 07:03:30.221174 --- ParallelTerminationStrategy: PID 20450 died... 07:03:30.240858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20450): Terminated: ok {rc=0} 07:03:30.287238 --- ParallelTerminationStrategy: PID 20451 died... 07:03:30.307057 run iperf3-srv_10.42.42.10(pid=20451): Terminated {rc=256} 07:03:30.353536 --- ParallelTerminationStrategy: PID 20452 died... 07:03:30.373376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20452): Terminated: ok {rc=0} 07:03:30.419976 --- ParallelTerminationStrategy: PID 20453 died... 07:03:30.439871 run iperf3-srv_10.42.42.10(pid=20453): Terminated {rc=256} 07:03:30.486309 --- ParallelTerminationStrategy: PID 20454 died... 07:03:30.506080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20454): Terminated: ok {rc=0} 07:03:30.552434 --- ParallelTerminationStrategy: PID 20455 died... 07:03:30.572270 run iperf3-srv_10.42.42.10(pid=20455): Terminated {rc=256} 07:03:30.618914 --- ParallelTerminationStrategy: PID 20458 died... 07:03:30.638904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20458): Terminated: ok {rc=0} 07:03:30.685293 --- ParallelTerminationStrategy: PID 20461 died... 07:03:30.704909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20461): Terminated: ok {rc=0} 07:03:30.751534 --- ParallelTerminationStrategy: PID 20464 died... 07:03:30.771417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20464): Terminated: ok {rc=0} 07:03:30.880308 bus /gobi_4: Setting Powered False 07:03:31.995665 bus /gobi_4: Setting Powered False 07:03:33.130290 bus /gobi_1: Setting Powered False 07:03:34.229189 bus /gobi_1: Setting Powered False 07:03:35.344320 bus /gobi_0: Setting Powered False 07:03:36.442544 bus /gobi_0: Setting Powered False 07:03:37.556900 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo ping.py ---------------------------------------------- 07:03:38.660316 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:38.672214 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:03:38.712143 tst ping.py: using LAC 39219 07:03:38.835890 tst ping.py: using RAC 204 07:03:38.954460 tst ping.py: using CellId 39219 07:03:39.072924 tst ping.py: using BVCI 39220 07:03:39.183377 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:39.194184 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:39.204774 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:39.215362 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:39.226455 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:39.237570 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:39.249073 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:39.260060 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:03:39.380739 tst ping.py:19: start network... 07:03:39.601816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:40.108499 run create_hlr_db(pid=20466): Launched 07:03:40.231963 bus /gobi_6: Setting Powered False 07:03:41.296685 run create_hlr_db(pid=20466): Terminated: ok {rc=0} 07:03:41.752107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20468): Launched 07:03:42.079087 run osmo-hlr_10.42.42.2(pid=20469): Launched 07:03:42.202844 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:42.774962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20471): Launched 07:03:43.100442 run osmo-stp_10.42.42.5(pid=20472): Launched 07:03:43.226600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:43.794676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20474): Launched 07:03:43.919711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:44.196202 run patchelf(pid=20475): Launched 07:03:44.377195 run osmo-stp_10.42.42.5(pid=20472): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20472)] 07:03:44.515511 run osmo-stp_10.42.42.5(pid=20472): stdout: | (launched: 2022-12-14_07:03:43.039310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:44.656126 run osmo-stp_10.42.42.5(pid=20472): stderr: | 20221214070343233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070343233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070343233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070343234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070343236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070343236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070343236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:44.796258 run osmo-stp_10.42.42.5(pid=20472): stdout: | (launched: 2022-12-14_07:03:43.039310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:44.929649 run osmo-stp_10.42.42.5(pid=20472): stderr: | 20221214070343233 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070343233 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070343233 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070343234 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070343236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070343236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070343236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:45.087367 run patchelf(pid=20475): Terminating (SIGINT) 07:03:45.270814 run patchelf(pid=20475): Terminated: ok {rc=0} 07:03:45.403001 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20472): Process ended prematurely: osmo-stp_10.42.42.5(pid=20472) [trial-2401↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20472)] [trial-2401↪gprs:sysmo↪ping.py:22] 07:03:45.412193 tst ping.py:22: Test FAILED (6.7 sec) 07:03:45.440004 run osmo-hlr_10.42.42.2(pid=20469): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20469)] 07:03:45.492279 run osmo-hlr_10.42.42.2(pid=20469): stdout: | (launched: 2022-12-14_07:03:42.017588) 07:03:45.544811 run osmo-hlr_10.42.42.2(pid=20469): stderr: | 20221214070342218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070342218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070342218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070342218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070342218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070342218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070342233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070342241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070342241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070342241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:45.598102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20468): Terminating (SIGTERM) 07:03:45.640333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20471): Terminating (SIGTERM) 07:03:45.683199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20474): Terminating (SIGTERM) 07:03:45.726115 --- ParallelTerminationStrategy: PID 20468 died... 07:03:45.746938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20468): Terminated: ok {rc=0} 07:03:45.793998 --- ParallelTerminationStrategy: PID 20471 died... 07:03:45.814238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20471): Terminated: ok {rc=0} 07:03:45.883495 --- ParallelTerminationStrategy: PID 20474 died... 07:03:45.903828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20474): Terminated: ok {rc=0} 07:03:45.998941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 07:03:47.100077 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:47.114435 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:03:47.158286 tst ping_idle_ping.py: using LAC 39220 07:03:47.293237 tst ping_idle_ping.py: using RAC 205 07:03:47.423936 tst ping_idle_ping.py: using CellId 39220 07:03:47.553646 tst ping_idle_ping.py: using BVCI 39221 07:03:47.665166 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:47.675939 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:47.686703 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:47.697328 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:47.708288 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:47.719437 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:47.730692 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:03:47.741766 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:03:47.865598 tst ping_idle_ping.py:24: start network... 07:03:48.070250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:48.541956 run create_hlr_db(pid=20476): Launched 07:03:48.665744 bus /gobi_6: Setting Powered False 07:03:49.726009 run create_hlr_db(pid=20476): Terminated: ok {rc=0} 07:03:50.172624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20478): Launched 07:03:50.500329 run osmo-hlr_10.42.42.2(pid=20479): Launched 07:03:50.625734 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:51.191822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20481): Launched 07:03:51.518897 run osmo-stp_10.42.42.5(pid=20482): Launched 07:03:51.643415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:52.209430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20484): Launched 07:03:52.335482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:52.616280 run patchelf(pid=20485): Launched 07:03:52.797985 run osmo-stp_10.42.42.5(pid=20482): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20482)] 07:03:52.936207 run osmo-stp_10.42.42.5(pid=20482): stdout: | (launched: 2022-12-14_07:03:51.457192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:53.076337 run osmo-stp_10.42.42.5(pid=20482): stderr: | 20221214070351651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070351651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070351651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070351652 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070351652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070351652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070351652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:53.216558 run osmo-stp_10.42.42.5(pid=20482): stdout: | (launched: 2022-12-14_07:03:51.457192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:53.350269 run osmo-stp_10.42.42.5(pid=20482): stderr: | 20221214070351651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070351651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070351651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070351652 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070351652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070351652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070351652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:53.508424 run patchelf(pid=20485): Terminating (SIGINT) 07:03:53.693469 run patchelf(pid=20485): Terminated: ok {rc=0} 07:03:53.826630 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20482): Process ended prematurely: osmo-stp_10.42.42.5(pid=20482) [trial-2401↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20482)] [trial-2401↪gprs:sysmo↪ping_idle_ping.py:27] 07:03:53.836217 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:03:53.864237 run osmo-hlr_10.42.42.2(pid=20479): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20479)] 07:03:53.915680 run osmo-hlr_10.42.42.2(pid=20479): stdout: | (launched: 2022-12-14_07:03:50.439120) 07:03:53.967757 run osmo-hlr_10.42.42.2(pid=20479): stderr: | 20221214070350640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070350640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070350640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070350640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070350640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070350640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070350651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070350659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070350659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070350659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:54.020763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20478): Terminating (SIGTERM) 07:03:54.062597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20481): Terminating (SIGTERM) 07:03:54.104886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20484): Terminating (SIGTERM) 07:03:54.147432 --- ParallelTerminationStrategy: PID 20478 died... 07:03:54.167838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20478): Terminated: ok {rc=0} 07:03:54.214517 --- ParallelTerminationStrategy: PID 20481 died... 07:03:54.235003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20481): Terminated: ok {rc=0} 07:03:54.281665 --- ParallelTerminationStrategy: PID 20484 died... 07:03:54.301770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20484): Terminated: ok {rc=0} 07:03:54.389795 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 07:03:55.675811 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:03:55.681470 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:03:55.702528 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:03:55.741403 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:03:55.829386 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:03:55.850683 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:03:55.888689 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:03:56.477625 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:03:56.533794 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:03:56.545262 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:03:56.587768 tst cs_paging_gprs_active.py: using LAC 39221 07:03:56.719161 tst cs_paging_gprs_active.py: using RAC 206 07:03:56.840638 tst cs_paging_gprs_active.py: using CellId 39221 07:03:56.961716 tst cs_paging_gprs_active.py: using BVCI 39222 07:03:57.076736 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:03:57.087638 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:03:57.098399 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:03:57.109068 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:03:57.120112 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:03:57.131240 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:03:57.142475 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:03:57.153909 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:03:57.165295 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:03:57.288108 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:03:57.408714 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:03:57.618724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:57.932183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20491): Launched 07:03:58.204042 run iperf3-srv_10.42.42.10(pid=20492): Launched 07:03:58.319816 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:03:58.526747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:58.839024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20493): Launched 07:03:59.110783 run iperf3-srv_10.42.42.10(pid=20494): Launched 07:03:59.226293 tst cs_paging_gprs_active.py:38: start network... 07:03:59.433596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:59.914533 run create_hlr_db(pid=20495): Launched 07:04:00.040213 bus /gobi_6: Setting Powered False 07:04:01.108227 run create_hlr_db(pid=20495): Terminated: ok {rc=0} 07:04:01.592512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20497): Launched 07:04:01.954781 run osmo-hlr_10.42.42.2(pid=20498): Launched 07:04:02.103009 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:02.641566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20500): Launched 07:04:02.954676 run osmo-stp_10.42.42.5(pid=20501): Launched 07:04:03.071595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:03.607086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20503): Launched 07:04:03.725569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:03.988676 run patchelf(pid=20504): Launched 07:04:04.160275 run osmo-stp_10.42.42.5(pid=20501): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20501)] 07:04:04.290663 run osmo-stp_10.42.42.5(pid=20501): stdout: | (launched: 2022-12-14_07:04:02.895291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:04.422090 run osmo-stp_10.42.42.5(pid=20501): stderr: | 20221214070403070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070403070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070403070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070403071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070403071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070403071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070403071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:04.553481 run osmo-stp_10.42.42.5(pid=20501): stdout: | (launched: 2022-12-14_07:04:02.895291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:04.679478 run osmo-stp_10.42.42.5(pid=20501): stderr: | 20221214070403070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070403070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070403070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070403071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070403071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070403071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070403071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:04.828865 run patchelf(pid=20504): Terminating (SIGINT) 07:04:05.003317 run patchelf(pid=20504): Terminated: ok {rc=0} 07:04:05.128808 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20501): Process ended prematurely: osmo-stp_10.42.42.5(pid=20501) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20501)] [trial-2401↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:04:05.138320 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:04:05.165460 run osmo-hlr_10.42.42.2(pid=20498): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20498)] 07:04:05.213067 run osmo-hlr_10.42.42.2(pid=20498): stdout: | (launched: 2022-12-14_07:04:01.886017) 07:04:05.262171 run osmo-hlr_10.42.42.2(pid=20498): stderr: | 20221214070402184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070402184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070402184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070402184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070402184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070402184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070402203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070402212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070402213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070402213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:05.311839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20491): Terminating (SIGTERM) 07:04:05.351883 run iperf3-srv_10.42.42.10(pid=20492): Terminating (SIGTERM) 07:04:05.391569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20493): Terminating (SIGTERM) 07:04:05.431490 run iperf3-srv_10.42.42.10(pid=20494): Terminating (SIGTERM) 07:04:05.471033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20497): Terminating (SIGTERM) 07:04:05.510780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20500): Terminating (SIGTERM) 07:04:05.550528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20503): Terminating (SIGTERM) 07:04:05.590418 --- ParallelTerminationStrategy: PID 20491 died... 07:04:05.609687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20491): Terminated: ok {rc=0} 07:04:05.654221 --- ParallelTerminationStrategy: PID 20492 died... 07:04:05.672633 run iperf3-srv_10.42.42.10(pid=20492): Terminated {rc=256} 07:04:05.716330 --- ParallelTerminationStrategy: PID 20493 died... 07:04:05.734957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20493): Terminated: ok {rc=0} 07:04:05.778651 --- ParallelTerminationStrategy: PID 20494 died... 07:04:05.796926 run iperf3-srv_10.42.42.10(pid=20494): Terminated {rc=256} 07:04:05.840622 --- ParallelTerminationStrategy: PID 20497 died... 07:04:05.859111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20497): Terminated: ok {rc=0} 07:04:05.902787 --- ParallelTerminationStrategy: PID 20500 died... 07:04:05.921410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20500): Terminated: ok {rc=0} 07:04:05.965299 --- ParallelTerminationStrategy: PID 20503 died... 07:04:05.983906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20503): Terminated: ok {rc=0} 07:04:06.069433 bus /gobi_0: Setting Powered False 07:04:07.171202 bus /gobi_0: Setting Powered False 07:04:08.288011 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:04:09.438194 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:09.450420 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:04:09.488316 tst iperf3.py: using LAC 39222 07:04:09.618944 tst iperf3.py: using RAC 207 07:04:09.750631 tst iperf3.py: using CellId 39222 07:04:09.881953 tst iperf3.py: using BVCI 39223 07:04:10.002983 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:10.014311 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:10.025555 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:10.036494 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:10.047859 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:10.059194 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:10.070818 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:10.082162 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:10.093942 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:04:10.220598 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:04:10.429349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:10.740115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20505): Launched 07:04:11.010484 run iperf3-srv_10.42.42.10(pid=20506): Launched 07:04:11.125630 tst iperf3.py:8: start network... 07:04:11.331197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:11.809688 run create_hlr_db(pid=20507): Launched 07:04:11.938508 bus /gobi_6: Setting Powered False 07:04:13.003565 run create_hlr_db(pid=20507): Terminated: ok {rc=0} 07:04:13.464724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20509): Launched 07:04:13.798844 run osmo-hlr_10.42.42.2(pid=20510): Launched 07:04:13.925866 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:14.497204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20512): Launched 07:04:14.832906 run osmo-stp_10.42.42.5(pid=20513): Launched 07:04:14.959271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:15.533521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20515): Launched 07:04:15.661878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:15.965177 run patchelf(pid=20516): Launched 07:04:16.164582 run osmo-stp_10.42.42.5(pid=20513): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20513)] 07:04:16.308372 run osmo-stp_10.42.42.5(pid=20513): stdout: | (launched: 2022-12-14_07:04:14.770296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:16.454275 run osmo-stp_10.42.42.5(pid=20513): stderr: | 20221214070414966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070414966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070414966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070414967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070414967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070414967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070414967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:16.600511 run osmo-stp_10.42.42.5(pid=20513): stdout: | (launched: 2022-12-14_07:04:14.770296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:16.740217 run osmo-stp_10.42.42.5(pid=20513): stderr: | 20221214070414966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070414966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070414966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070414967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070414967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070414967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070414967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:16.904931 run patchelf(pid=20516): Terminating (SIGINT) 07:04:17.095679 run patchelf(pid=20516): Terminated: ok {rc=0} 07:04:17.232940 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20513): Process ended prematurely: osmo-stp_10.42.42.5(pid=20513) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20513)] [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 07:04:17.243307 tst iperf3.py:8: Test FAILED (7.8 sec) 07:04:17.271886 run osmo-hlr_10.42.42.2(pid=20510): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20510)] 07:04:17.323471 run osmo-hlr_10.42.42.2(pid=20510): stdout: | (launched: 2022-12-14_07:04:13.736465) 07:04:17.375932 run osmo-hlr_10.42.42.2(pid=20510): stderr: | 20221214070413940 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070413940 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070413940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070413940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070413940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070413940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070413952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070413960 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070413960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070413960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:17.428828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20505): Terminating (SIGTERM) 07:04:17.470834 run iperf3-srv_10.42.42.10(pid=20506): Terminating (SIGTERM) 07:04:17.514637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20509): Terminating (SIGTERM) 07:04:17.557698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20512): Terminating (SIGTERM) 07:04:17.600181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20515): Terminating (SIGTERM) 07:04:17.643090 --- ParallelTerminationStrategy: PID 20505 died... 07:04:17.663650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20505): Terminated: ok {rc=0} 07:04:17.710497 --- ParallelTerminationStrategy: PID 20506 died... 07:04:17.730595 run iperf3-srv_10.42.42.10(pid=20506): Terminated {rc=256} 07:04:17.776888 --- ParallelTerminationStrategy: PID 20509 died... 07:04:17.797460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20509): Terminated: ok {rc=0} 07:04:17.844126 --- ParallelTerminationStrategy: PID 20512 died... 07:04:17.864239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20512): Terminated: ok {rc=0} 07:04:17.910844 --- ParallelTerminationStrategy: PID 20515 died... 07:04:17.930809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20515): Terminated: ok {rc=0} 07:04:18.018401 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:04:19.169616 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:19.181768 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:04:19.219158 tst iperf3m4.py: using LAC 39223 07:04:19.348697 tst iperf3m4.py: using RAC 208 07:04:19.480468 tst iperf3m4.py: using CellId 39223 07:04:19.612456 tst iperf3m4.py: using BVCI 39224 07:04:19.735775 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:19.747371 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:19.758552 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:19.769722 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:19.781064 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:19.792461 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:19.804258 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:19.815756 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:19.827706 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:04:19.947047 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:04:20.072610 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:04:20.196116 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:04:20.317777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:04:20.526823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:20.841838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20517): Launched 07:04:21.112185 run iperf3-srv_10.42.42.10(pid=20518): Launched 07:04:21.227187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:04:21.433568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:21.744623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20519): Launched 07:04:22.017191 run iperf3-srv_10.42.42.10(pid=20520): Launched 07:04:22.132462 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:04:22.338368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:22.649748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20521): Launched 07:04:22.922409 run iperf3-srv_10.42.42.10(pid=20522): Launched 07:04:23.037651 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:04:23.244064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:23.555771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20523): Launched 07:04:23.827241 run iperf3-srv_10.42.42.10(pid=20524): Launched 07:04:23.942682 tst iperf3m4.py:8: start network... 07:04:24.148930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:24.627249 run create_hlr_db(pid=20525): Launched 07:04:24.753240 bus /gobi_6: Setting Powered False 07:04:25.815674 run create_hlr_db(pid=20525): Terminated: ok {rc=0} 07:04:26.267976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20527): Launched 07:04:26.601407 run osmo-hlr_10.42.42.2(pid=20528): Launched 07:04:26.728427 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:27.304788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20530): Launched 07:04:27.638489 run osmo-stp_10.42.42.5(pid=20531): Launched 07:04:27.764861 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:28.338909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20533): Launched 07:04:28.466082 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:28.748069 run patchelf(pid=20534): Launched 07:04:28.934115 run osmo-stp_10.42.42.5(pid=20531): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20531)] 07:04:29.073790 run osmo-stp_10.42.42.5(pid=20531): stdout: | (launched: 2022-12-14_07:04:27.575703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:29.215020 run osmo-stp_10.42.42.5(pid=20531): stderr: | 20221214070427771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070427771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070427772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070427772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070427774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070427775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070427775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:29.356763 run osmo-stp_10.42.42.5(pid=20531): stdout: | (launched: 2022-12-14_07:04:27.575703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:29.491724 run osmo-stp_10.42.42.5(pid=20531): stderr: | 20221214070427771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070427771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070427772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070427772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070427774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070427775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070427775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:29.652567 run patchelf(pid=20534): Terminating (SIGINT) 07:04:29.839091 run patchelf(pid=20534): Terminated: ok {rc=0} 07:04:29.973880 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20531): Process ended prematurely: osmo-stp_10.42.42.5(pid=20531) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20531)] [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 07:04:29.983908 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:04:30.012492 run osmo-hlr_10.42.42.2(pid=20528): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20528)] 07:04:30.063662 run osmo-hlr_10.42.42.2(pid=20528): stdout: | (launched: 2022-12-14_07:04:26.539098) 07:04:30.115911 run osmo-hlr_10.42.42.2(pid=20528): stderr: | 20221214070426739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070426739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070426739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070426739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070426739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070426739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070426752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070426760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070426760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070426760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:30.168602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20517): Terminating (SIGTERM) 07:04:30.210468 run iperf3-srv_10.42.42.10(pid=20518): Terminating (SIGTERM) 07:04:30.252757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20519): Terminating (SIGTERM) 07:04:30.294946 run iperf3-srv_10.42.42.10(pid=20520): Terminating (SIGTERM) 07:04:30.338476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20521): Terminating (SIGTERM) 07:04:30.380775 run iperf3-srv_10.42.42.10(pid=20522): Terminating (SIGTERM) 07:04:30.422769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20523): Terminating (SIGTERM) 07:04:30.464773 run iperf3-srv_10.42.42.10(pid=20524): Terminating (SIGTERM) 07:04:30.506713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20527): Terminating (SIGTERM) 07:04:30.549037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20530): Terminating (SIGTERM) 07:04:30.590888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20533): Terminating (SIGTERM) 07:04:30.633586 --- ParallelTerminationStrategy: PID 20517 died... 07:04:30.654093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20517): Terminated: ok {rc=0} 07:04:30.700866 --- ParallelTerminationStrategy: PID 20518 died... 07:04:30.720813 run iperf3-srv_10.42.42.10(pid=20518): Terminated {rc=256} 07:04:30.767036 --- ParallelTerminationStrategy: PID 20519 died... 07:04:30.786896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20519): Terminated: ok {rc=0} 07:04:30.833721 --- ParallelTerminationStrategy: PID 20520 died... 07:04:30.866795 run iperf3-srv_10.42.42.10(pid=20520): Terminated {rc=256} 07:04:30.923239 --- ParallelTerminationStrategy: PID 20521 died... 07:04:30.943535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20521): Terminated: ok {rc=0} 07:04:30.997680 --- ParallelTerminationStrategy: PID 20522 died... 07:04:31.021043 run iperf3-srv_10.42.42.10(pid=20522): Terminated {rc=256} 07:04:31.068687 --- ParallelTerminationStrategy: PID 20523 died... 07:04:31.089391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20523): Terminated: ok {rc=0} 07:04:31.136827 --- ParallelTerminationStrategy: PID 20524 died... 07:04:31.157697 run iperf3-srv_10.42.42.10(pid=20524): Terminated {rc=256} 07:04:31.205075 --- ParallelTerminationStrategy: PID 20527 died... 07:04:31.225629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20527): Terminated: ok {rc=0} 07:04:31.273034 --- ParallelTerminationStrategy: PID 20530 died... 07:04:31.293692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20530): Terminated: ok {rc=0} 07:04:31.341281 --- ParallelTerminationStrategy: PID 20533 died... 07:04:31.361959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20533): Terminated: ok {rc=0} 07:04:31.457142 bus /gobi_4: Setting Powered False 07:04:32.552988 bus /gobi_4: Setting Powered False 07:04:33.669691 bus /gobi_1: Setting Powered False 07:04:34.771172 bus /gobi_1: Setting Powered False 07:04:35.889716 bus /gobi_0: Setting Powered False 07:04:36.988615 bus /gobi_0: Setting Powered False 07:04:38.105910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 07:04:39.206453 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:39.218212 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:04:39.259911 tst ping.py: using LAC 39224 07:04:39.392122 tst ping.py: using RAC 209 07:04:39.514192 tst ping.py: using CellId 39224 07:04:39.634670 tst ping.py: using BVCI 39225 07:04:39.745721 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:39.756705 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:39.767620 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:39.778378 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:39.788927 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:39.799772 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:39.810831 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:39.821849 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:04:39.946022 tst ping.py:19: start network... 07:04:40.149813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:40.619936 run create_hlr_db(pid=20535): Launched 07:04:40.742216 bus /gobi_6: Setting Powered False 07:04:41.802407 run create_hlr_db(pid=20535): Terminated: ok {rc=0} 07:04:42.227180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20537): Launched 07:04:42.530883 run osmo-hlr_10.42.42.2(pid=20538): Launched 07:04:42.645234 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:43.164448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20540): Launched 07:04:43.467342 run osmo-stp_10.42.42.5(pid=20541): Launched 07:04:43.582007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:44.123062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20543): Launched 07:04:44.238493 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:44.495382 run patchelf(pid=20544): Launched 07:04:44.663730 run osmo-stp_10.42.42.5(pid=20541): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20541)] 07:04:44.791497 run osmo-stp_10.42.42.5(pid=20541): stdout: | (launched: 2022-12-14_07:04:43.409784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:44.921121 run osmo-stp_10.42.42.5(pid=20541): stderr: | 20221214070443586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070443586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070443586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070443586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070443587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070443587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070443587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:45.050692 run osmo-stp_10.42.42.5(pid=20541): stdout: | (launched: 2022-12-14_07:04:43.409784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:45.173847 run osmo-stp_10.42.42.5(pid=20541): stderr: | 20221214070443586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070443586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070443586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070443586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070443587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070443587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070443587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:45.319797 run patchelf(pid=20544): Terminating (SIGINT) 07:04:45.490695 run patchelf(pid=20544): Terminated: ok {rc=0} 07:04:45.613411 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20541): Process ended prematurely: osmo-stp_10.42.42.5(pid=20541) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20541)] [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 07:04:45.622182 tst ping.py:22: Test FAILED (6.4 sec) 07:04:45.648575 run osmo-hlr_10.42.42.2(pid=20538): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20538)] 07:04:45.696448 run osmo-hlr_10.42.42.2(pid=20538): stdout: | (launched: 2022-12-14_07:04:42.473291) 07:04:45.745744 run osmo-hlr_10.42.42.2(pid=20538): stderr: | 20221214070442653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070442653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070442653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070442653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070442653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070442653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070442692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070442701 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070442701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070442701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:45.795551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20537): Terminating (SIGTERM) 07:04:45.839469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20540): Terminating (SIGTERM) 07:04:45.883803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20543): Terminating (SIGTERM) 07:04:45.925173 --- ParallelTerminationStrategy: PID 20537 died... 07:04:45.945468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20537): Terminated: ok {rc=0} 07:04:45.991245 --- ParallelTerminationStrategy: PID 20540 died... 07:04:46.011651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20540): Terminated: ok {rc=0} 07:04:46.057861 --- ParallelTerminationStrategy: PID 20543 died... 07:04:46.077631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20543): Terminated: ok {rc=0} 07:04:46.167000 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:04:47.259343 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:47.272001 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:04:47.311101 tst ping_idle_ping.py: using LAC 39225 07:04:47.433120 tst ping_idle_ping.py: using RAC 210 07:04:47.551936 tst ping_idle_ping.py: using CellId 39225 07:04:47.673269 tst ping_idle_ping.py: using BVCI 39226 07:04:47.783095 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:47.794235 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:47.805214 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:47.816116 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:47.827232 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:47.838250 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:47.849421 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:04:47.860330 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:04:47.983255 tst ping_idle_ping.py:24: start network... 07:04:48.186947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:48.657724 run create_hlr_db(pid=20545): Launched 07:04:48.783646 bus /gobi_6: Setting Powered False 07:04:49.843660 run create_hlr_db(pid=20545): Terminated: ok {rc=0} 07:04:50.292384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Launched 07:04:50.620254 run osmo-hlr_10.42.42.2(pid=20548): Launched 07:04:50.745712 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:51.311810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Launched 07:04:51.638384 run osmo-stp_10.42.42.5(pid=20551): Launched 07:04:51.763578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:52.330625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20553): Launched 07:04:52.455704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:52.734594 run patchelf(pid=20554): Launched 07:04:52.917369 run osmo-stp_10.42.42.5(pid=20551): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] 07:04:53.055485 run osmo-stp_10.42.42.5(pid=20551): stdout: | (launched: 2022-12-14_07:04:51.577306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:53.195394 run osmo-stp_10.42.42.5(pid=20551): stderr: | 20221214070451772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070451772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070451772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070451773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070451773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070451773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070451774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:53.335052 run osmo-stp_10.42.42.5(pid=20551): stdout: | (launched: 2022-12-14_07:04:51.577306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:53.468339 run osmo-stp_10.42.42.5(pid=20551): stderr: | 20221214070451772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070451772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070451772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070451773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070451773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070451773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070451774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:53.626636 run patchelf(pid=20554): Terminating (SIGINT) 07:04:53.810949 run patchelf(pid=20554): Terminated: ok {rc=0} 07:04:53.943572 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20551): Process ended prematurely: osmo-stp_10.42.42.5(pid=20551) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 07:04:53.953147 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:04:53.981060 run osmo-hlr_10.42.42.2(pid=20548): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20548)] 07:04:54.031759 run osmo-hlr_10.42.42.2(pid=20548): stdout: | (launched: 2022-12-14_07:04:50.559014) 07:04:54.084108 run osmo-hlr_10.42.42.2(pid=20548): stderr: | 20221214070450760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070450761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070450761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070450761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070450761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070450761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070450777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070450787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070450787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070450787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:54.137132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Terminating (SIGTERM) 07:04:54.179036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Terminating (SIGTERM) 07:04:54.221638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20553): Terminating (SIGTERM) 07:04:54.264208 --- ParallelTerminationStrategy: PID 20547 died... 07:04:54.284898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20547): Terminated: ok {rc=0} 07:04:54.331320 --- ParallelTerminationStrategy: PID 20550 died... 07:04:54.351292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20550): Terminated: ok {rc=0} 07:04:54.397501 --- ParallelTerminationStrategy: PID 20553 died... 07:04:54.417350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20553): Terminated: ok {rc=0} 07:04:54.506716 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:04:55.802233 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:04:55.808815 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:04:55.830417 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:04:55.870548 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:04:55.961747 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:04:55.983804 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:04:56.023443 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:04:56.615546 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:04:56.670142 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:56.681487 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:04:56.739464 tst cs_paging_gprs_active.py: using LAC 39226 07:04:56.871575 tst cs_paging_gprs_active.py: using RAC 211 07:04:57.003581 tst cs_paging_gprs_active.py: using CellId 39226 07:04:57.135737 tst cs_paging_gprs_active.py: using BVCI 39227 07:04:57.258726 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:57.270292 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:57.281654 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:57.292892 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:57.304417 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:57.316026 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:57.327651 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:57.338946 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:04:57.350799 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:04:57.468896 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:04:57.592364 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:04:57.817677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:58.153181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20558): Launched 07:04:58.443052 run iperf3-srv_10.42.42.10(pid=20559): Launched 07:04:58.567403 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:04:58.791968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:04:59.127091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20560): Launched 07:04:59.416924 run iperf3-srv_10.42.42.10(pid=20561): Launched 07:04:59.540899 tst cs_paging_gprs_active.py:38: start network... 07:04:59.765862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:00.281684 run create_hlr_db(pid=20562): Launched 07:05:00.408046 bus /gobi_6: Setting Powered False 07:05:01.473327 run create_hlr_db(pid=20562): Terminated: ok {rc=0} 07:05:02.008096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20567): Launched 07:05:02.334966 run osmo-hlr_10.42.42.2(pid=20568): Launched 07:05:02.452931 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:03.003063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20570): Launched 07:05:03.313374 run osmo-stp_10.42.42.5(pid=20571): Launched 07:05:03.430524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:05:03.963819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20573): Launched 07:05:04.082458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:05:04.345502 run patchelf(pid=20574): Launched 07:05:04.518313 run osmo-stp_10.42.42.5(pid=20571): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20571)] 07:05:04.649718 run osmo-stp_10.42.42.5(pid=20571): stdout: | (launched: 2022-12-14_07:05:03.254469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:04.783031 run osmo-stp_10.42.42.5(pid=20571): stderr: | 20221214070503429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070503429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070503429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070503429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070503430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070503430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070503430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:04.915941 run osmo-stp_10.42.42.5(pid=20571): stdout: | (launched: 2022-12-14_07:05:03.254469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:05.042830 run osmo-stp_10.42.42.5(pid=20571): stderr: | 20221214070503429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070503429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070503429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070503429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070503430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070503430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070503430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:05.193675 run patchelf(pid=20574): Terminating (SIGINT) 07:05:05.370028 run patchelf(pid=20574): Terminated: ok {rc=0} 07:05:05.497076 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20571): Process ended prematurely: osmo-stp_10.42.42.5(pid=20571) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20571)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:05:05.506322 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 07:05:05.533219 run osmo-hlr_10.42.42.2(pid=20568): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20568)] 07:05:05.580863 run osmo-hlr_10.42.42.2(pid=20568): stdout: | (launched: 2022-12-14_07:05:02.276060) 07:05:05.629877 run osmo-hlr_10.42.42.2(pid=20568): stderr: | 20221214070502454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070502454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070502454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070502455 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070502455 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070502455 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070502467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070502475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070502475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070502476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:05.679308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20558): Terminating (SIGTERM) 07:05:05.719540 run iperf3-srv_10.42.42.10(pid=20559): Terminating (SIGTERM) 07:05:05.759134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20560): Terminating (SIGTERM) 07:05:05.798711 run iperf3-srv_10.42.42.10(pid=20561): Terminating (SIGTERM) 07:05:05.838400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20567): Terminating (SIGTERM) 07:05:05.878023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20570): Terminating (SIGTERM) 07:05:05.917625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20573): Terminating (SIGTERM) 07:05:05.957279 --- ParallelTerminationStrategy: PID 20558 died... 07:05:05.976573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20558): Terminated: ok {rc=0} 07:05:06.020625 --- ParallelTerminationStrategy: PID 20559 died... 07:05:06.039501 run iperf3-srv_10.42.42.10(pid=20559): Terminated {rc=256} 07:05:06.083114 --- ParallelTerminationStrategy: PID 20560 died... 07:05:06.102180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20560): Terminated: ok {rc=0} 07:05:06.145813 --- ParallelTerminationStrategy: PID 20561 died... 07:05:06.164424 run iperf3-srv_10.42.42.10(pid=20561): Terminated {rc=256} 07:05:06.207860 --- ParallelTerminationStrategy: PID 20567 died... 07:05:06.226734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20567): Terminated: ok {rc=0} 07:05:06.270469 --- ParallelTerminationStrategy: PID 20570 died... 07:05:06.289354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20570): Terminated: ok {rc=0} 07:05:06.333179 --- ParallelTerminationStrategy: PID 20573 died... 07:05:06.351852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20573): Terminated: ok {rc=0} 07:05:06.437414 bus /gobi_0: Setting Powered False 07:05:07.536416 bus /gobi_0: Setting Powered False 07:05:08.652086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:05:09.799665 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:09.811360 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:05:09.870650 tst iperf3.py: using LAC 39227 07:05:09.993376 tst iperf3.py: using RAC 212 07:05:10.116918 tst iperf3.py: using CellId 39227 07:05:10.241706 tst iperf3.py: using BVCI 39228 07:05:10.355284 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:10.366378 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:10.377283 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:10.388030 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:10.398733 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:10.409326 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:10.420203 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:10.430859 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:10.441721 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:05:10.557872 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:05:10.764660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:05:11.076294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20575): Launched 07:05:11.348036 run iperf3-srv_10.42.42.10(pid=20576): Launched 07:05:11.463438 tst iperf3.py:8: start network... 07:05:11.670202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:12.148816 run create_hlr_db(pid=20577): Launched 07:05:12.275298 bus /gobi_6: Setting Powered False 07:05:13.340055 run create_hlr_db(pid=20577): Terminated: ok {rc=0} 07:05:13.809039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20579): Launched 07:05:14.144515 run osmo-hlr_10.42.42.2(pid=20580): Launched 07:05:14.270723 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:14.847634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20582): Launched 07:05:15.180889 run osmo-stp_10.42.42.5(pid=20583): Launched 07:05:15.307656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:05:15.903532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20585): Launched 07:05:16.043598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:05:16.332907 run patchelf(pid=20586): Launched 07:05:16.535533 run osmo-stp_10.42.42.5(pid=20583): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20583)] 07:05:16.680037 run osmo-stp_10.42.42.5(pid=20583): stdout: | (launched: 2022-12-14_07:05:15.118387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:16.825826 run osmo-stp_10.42.42.5(pid=20583): stderr: | 20221214070515313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070515313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070515313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070515313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070515314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070515314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070515314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:16.973601 run osmo-stp_10.42.42.5(pid=20583): stdout: | (launched: 2022-12-14_07:05:15.118387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:17.112533 run osmo-stp_10.42.42.5(pid=20583): stderr: | 20221214070515313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070515313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070515313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070515313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070515314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070515314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070515314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:17.275505 run patchelf(pid=20586): Terminating (SIGINT) 07:05:17.462560 run patchelf(pid=20586): Terminated: ok {rc=0} 07:05:17.598066 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20583): Process ended prematurely: osmo-stp_10.42.42.5(pid=20583) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20583)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 07:05:17.608350 tst iperf3.py:8: Test FAILED (7.8 sec) 07:05:17.637220 run osmo-hlr_10.42.42.2(pid=20580): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20580)] 07:05:17.688889 run osmo-hlr_10.42.42.2(pid=20580): stdout: | (launched: 2022-12-14_07:05:14.082130) 07:05:17.741390 run osmo-hlr_10.42.42.2(pid=20580): stderr: | 20221214070514283 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070514283 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070514283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070514283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070514283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070514283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070514295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070514303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070514304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070514304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:17.793952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20575): Terminating (SIGTERM) 07:05:17.835656 run iperf3-srv_10.42.42.10(pid=20576): Terminating (SIGTERM) 07:05:17.877897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20579): Terminating (SIGTERM) 07:05:17.920249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20582): Terminating (SIGTERM) 07:05:17.963104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20585): Terminating (SIGTERM) 07:05:18.005986 --- ParallelTerminationStrategy: PID 20575 died... 07:05:18.026458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20575): Terminated: ok {rc=0} 07:05:18.073270 --- ParallelTerminationStrategy: PID 20576 died... 07:05:18.093297 run iperf3-srv_10.42.42.10(pid=20576): Terminated {rc=256} 07:05:18.139471 --- ParallelTerminationStrategy: PID 20579 died... 07:05:18.159281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20579): Terminated: ok {rc=0} 07:05:18.205727 --- ParallelTerminationStrategy: PID 20582 died... 07:05:18.225784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20582): Terminated: ok {rc=0} 07:05:18.272383 --- ParallelTerminationStrategy: PID 20585 died... 07:05:18.292368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20585): Terminated: ok {rc=0} 07:05:18.380865 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:05:19.532354 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:19.544540 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:05:19.604760 tst iperf3m4.py: using LAC 39228 07:05:19.740548 tst iperf3m4.py: using RAC 213 07:05:19.870325 tst iperf3m4.py: using CellId 39228 07:05:20.000800 tst iperf3m4.py: using BVCI 39229 07:05:20.124064 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:20.135592 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:20.146766 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:20.157979 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:20.169916 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:20.181981 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:20.194398 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:20.206394 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:20.218693 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:05:20.340570 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:05:20.466156 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:05:20.583522 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:05:20.708235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:05:20.933855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:05:21.270470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20587): Launched 07:05:21.562706 run iperf3-srv_10.42.42.10(pid=20588): Launched 07:05:21.687473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:05:21.911522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:05:22.246940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20590): Launched 07:05:22.537643 run iperf3-srv_10.42.42.10(pid=20591): Launched 07:05:22.663370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:05:22.889185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:05:23.226128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20592): Launched 07:05:23.519375 run iperf3-srv_10.42.42.10(pid=20593): Launched 07:05:23.643587 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:05:23.867839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:05:24.203142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20594): Launched 07:05:24.494863 run iperf3-srv_10.42.42.10(pid=20595): Launched 07:05:24.619220 tst iperf3m4.py:8: start network... 07:05:24.843687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:25.359149 run create_hlr_db(pid=20596): Launched 07:05:25.485163 bus /gobi_6: Setting Powered False 07:05:26.549895 run create_hlr_db(pid=20596): Terminated: ok {rc=0} 07:05:26.992831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20598): Launched 07:05:27.302656 run osmo-hlr_10.42.42.2(pid=20599): Launched 07:05:27.419661 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:27.953619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20601): Launched 07:05:28.263080 run osmo-stp_10.42.42.5(pid=20602): Launched 07:05:28.380761 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:05:28.912515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20604): Launched 07:05:29.030478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:05:29.291647 run patchelf(pid=20605): Launched 07:05:29.463266 run osmo-stp_10.42.42.5(pid=20602): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20602)] 07:05:29.592888 run osmo-stp_10.42.42.5(pid=20602): stdout: | (launched: 2022-12-14_07:05:28.204023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:29.724670 run osmo-stp_10.42.42.5(pid=20602): stderr: | 20221214070528379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070528379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070528379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070528380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070528380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070528380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070528380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:29.856082 run osmo-stp_10.42.42.5(pid=20602): stdout: | (launched: 2022-12-14_07:05:28.204023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:29.981338 run osmo-stp_10.42.42.5(pid=20602): stderr: | 20221214070528379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070528379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070528379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070528380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070528380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070528380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070528380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:30.129884 run patchelf(pid=20605): Terminating (SIGINT) 07:05:30.304369 run patchelf(pid=20605): Terminated: ok {rc=0} 07:05:30.430102 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20602): Process ended prematurely: osmo-stp_10.42.42.5(pid=20602) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20602)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:05:30.439484 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:05:30.466589 run osmo-hlr_10.42.42.2(pid=20599): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20599)] 07:05:30.513870 run osmo-hlr_10.42.42.2(pid=20599): stdout: | (launched: 2022-12-14_07:05:27.243998) 07:05:30.563150 run osmo-hlr_10.42.42.2(pid=20599): stderr: | 20221214070527423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070527424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070527424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070527424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070527424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070527424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070527436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070527445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070527445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070527445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:30.612701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20587): Terminating (SIGTERM) 07:05:30.652332 run iperf3-srv_10.42.42.10(pid=20588): Terminating (SIGTERM) 07:05:30.691787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20590): Terminating (SIGTERM) 07:05:30.731593 run iperf3-srv_10.42.42.10(pid=20591): Terminating (SIGTERM) 07:05:30.771214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20592): Terminating (SIGTERM) 07:05:30.810806 run iperf3-srv_10.42.42.10(pid=20593): Terminating (SIGTERM) 07:05:30.862225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20594): Terminating (SIGTERM) 07:05:30.908665 run iperf3-srv_10.42.42.10(pid=20595): Terminating (SIGTERM) 07:05:30.954810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20598): Terminating (SIGTERM) 07:05:31.000515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20601): Terminating (SIGTERM) 07:05:31.050059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20604): Terminating (SIGTERM) 07:05:31.097662 --- ParallelTerminationStrategy: PID 20587 died... 07:05:31.120745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20587): Terminated: ok {rc=0} 07:05:31.173076 --- ParallelTerminationStrategy: PID 20588 died... 07:05:31.193716 run iperf3-srv_10.42.42.10(pid=20588): Terminated {rc=256} 07:05:31.242241 --- ParallelTerminationStrategy: PID 20590 died... 07:05:31.263795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20590): Terminated: ok {rc=0} 07:05:31.312543 --- ParallelTerminationStrategy: PID 20591 died... 07:05:31.335184 run iperf3-srv_10.42.42.10(pid=20591): Terminated {rc=256} 07:05:31.384327 --- ParallelTerminationStrategy: PID 20592 died... 07:05:31.406522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20592): Terminated: ok {rc=0} 07:05:31.454960 --- ParallelTerminationStrategy: PID 20593 died... 07:05:31.476622 run iperf3-srv_10.42.42.10(pid=20593): Terminated {rc=256} 07:05:31.526117 --- ParallelTerminationStrategy: PID 20594 died... 07:05:31.547521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20594): Terminated: ok {rc=0} 07:05:31.597416 --- ParallelTerminationStrategy: PID 20595 died... 07:05:31.619142 run iperf3-srv_10.42.42.10(pid=20595): Terminated {rc=256} 07:05:31.669313 --- ParallelTerminationStrategy: PID 20598 died... 07:05:31.689998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20598): Terminated: ok {rc=0} 07:05:31.740105 --- ParallelTerminationStrategy: PID 20601 died... 07:05:31.761757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20601): Terminated: ok {rc=0} 07:05:31.810060 --- ParallelTerminationStrategy: PID 20604 died... 07:05:31.831332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20604): Terminated: ok {rc=0} 07:05:31.929391 bus /gobi_4: Setting Powered False 07:05:33.039175 bus /gobi_4: Setting Powered False 07:05:34.154588 bus /gobi_1: Setting Powered False 07:05:35.253983 bus /gobi_1: Setting Powered False 07:05:36.370222 bus /gobi_0: Setting Powered False 07:05:37.469072 bus /gobi_0: Setting Powered False 07:05:38.590089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:05:39.694240 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:39.705720 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:05:39.765895 tst ping.py: using LAC 39229 07:05:39.884080 tst ping.py: using RAC 214 07:05:40.010831 tst ping.py: using CellId 39229 07:05:40.138484 tst ping.py: using BVCI 39230 07:05:40.259348 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:40.271017 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:40.282371 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:40.293883 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:40.305675 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:40.317512 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:40.329706 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:40.341418 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:05:40.462636 tst ping.py:19: start network... 07:05:40.683263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:41.190189 run create_hlr_db(pid=20606): Launched 07:05:41.314458 bus /gobi_6: Setting Powered False 07:05:42.378553 run create_hlr_db(pid=20606): Terminated: ok {rc=0} 07:05:42.835235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20608): Launched 07:05:43.162825 run osmo-hlr_10.42.42.2(pid=20609): Launched 07:05:43.286905 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:43.856683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20611): Launched 07:05:44.183472 run osmo-stp_10.42.42.5(pid=20612): Launched 07:05:44.307095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:05:44.870163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20614): Launched 07:05:44.995328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:05:45.272016 run patchelf(pid=20615): Launched 07:05:45.452340 run osmo-stp_10.42.42.5(pid=20612): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20612)] 07:05:45.589767 run osmo-stp_10.42.42.5(pid=20612): stdout: | (launched: 2022-12-14_07:05:44.122321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:45.729545 run osmo-stp_10.42.42.5(pid=20612): stderr: | 20221214070544318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070544318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070544318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070544319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070544319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070544319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070544319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:45.882139 run osmo-stp_10.42.42.5(pid=20612): stdout: | (launched: 2022-12-14_07:05:44.122321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:46.027612 run osmo-stp_10.42.42.5(pid=20612): stderr: | 20221214070544318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070544318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070544318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070544319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070544319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070544319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070544319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:46.191368 run patchelf(pid=20615): Terminating (SIGINT) 07:05:46.379698 run patchelf(pid=20615): Terminated: ok {rc=0} 07:05:46.514990 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20612): Process ended prematurely: osmo-stp_10.42.42.5(pid=20612) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20612)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 07:05:46.525389 tst ping.py:22: Test FAILED (6.8 sec) 07:05:46.554497 run osmo-hlr_10.42.42.2(pid=20609): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20609)] 07:05:46.607573 run osmo-hlr_10.42.42.2(pid=20609): stdout: | (launched: 2022-12-14_07:05:43.101434) 07:05:46.663319 run osmo-hlr_10.42.42.2(pid=20609): stderr: | 20221214070543300 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070543300 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070543300 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070543300 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070543300 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070543300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070543313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070543322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070543323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070543323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:46.718481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20608): Terminating (SIGTERM) 07:05:46.762200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20611): Terminating (SIGTERM) 07:05:46.807974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20614): Terminating (SIGTERM) 07:05:46.852580 --- ParallelTerminationStrategy: PID 20608 died... 07:05:46.874389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20608): Terminated: ok {rc=0} 07:05:46.923943 --- ParallelTerminationStrategy: PID 20611 died... 07:05:46.944557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20611): Terminated: ok {rc=0} 07:05:46.993113 --- ParallelTerminationStrategy: PID 20614 died... 07:05:47.014329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20614): Terminated: ok {rc=0} 07:05:47.106645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:05:48.194895 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:48.206480 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:05:48.263459 tst ping_idle_ping.py: using LAC 39230 07:05:48.383951 tst ping_idle_ping.py: using RAC 215 07:05:48.505098 tst ping_idle_ping.py: using CellId 39230 07:05:48.623947 tst ping_idle_ping.py: using BVCI 39231 07:05:48.744663 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:48.756348 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:48.767812 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:48.779236 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:48.790971 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:48.802690 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:48.814612 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:05:48.826187 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:05:48.942990 tst ping_idle_ping.py:24: start network... 07:05:49.145931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:49.616524 run create_hlr_db(pid=20616): Launched 07:05:49.740269 bus /gobi_6: Setting Powered False 07:05:50.801168 run create_hlr_db(pid=20616): Terminated: ok {rc=0} 07:05:51.227089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20618): Launched 07:05:51.533047 run osmo-hlr_10.42.42.2(pid=20619): Launched 07:05:51.648364 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:52.194806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20625): Launched 07:05:52.524520 run osmo-stp_10.42.42.5(pid=20626): Launched 07:05:52.650125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:05:53.217117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20628): Launched 07:05:53.342378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:05:53.619567 run patchelf(pid=20629): Launched 07:05:53.801409 run osmo-stp_10.42.42.5(pid=20626): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20626)] 07:05:53.939778 run osmo-stp_10.42.42.5(pid=20626): stdout: | (launched: 2022-12-14_07:05:52.461906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:54.079635 run osmo-stp_10.42.42.5(pid=20626): stderr: | 20221214070552656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070552656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070552656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070552656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070552659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070552659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070552659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:54.219855 run osmo-stp_10.42.42.5(pid=20626): stdout: | (launched: 2022-12-14_07:05:52.461906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:54.353390 run osmo-stp_10.42.42.5(pid=20626): stderr: | 20221214070552656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070552656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070552656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070552656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070552659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070552659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070552659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:54.512154 run patchelf(pid=20629): Terminating (SIGINT) 07:05:54.697125 run patchelf(pid=20629): Terminated: ok {rc=0} 07:05:54.830057 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20626): Process ended prematurely: osmo-stp_10.42.42.5(pid=20626) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20626)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:05:54.839370 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:05:54.867283 run osmo-hlr_10.42.42.2(pid=20619): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20619)] 07:05:54.918294 run osmo-hlr_10.42.42.2(pid=20619): stdout: | (launched: 2022-12-14_07:05:51.474909) 07:05:54.970424 run osmo-hlr_10.42.42.2(pid=20619): stderr: | 20221214070551655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070551655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070551655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070551655 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070551655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070551655 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070551670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070551680 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070551681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070551681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:55.022856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20618): Terminating (SIGTERM) 07:05:55.064701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20625): Terminating (SIGTERM) 07:05:55.107121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20628): Terminating (SIGTERM) 07:05:55.149642 --- ParallelTerminationStrategy: PID 20618 died... 07:05:55.170011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20618): Terminated: ok {rc=0} 07:05:55.216517 --- ParallelTerminationStrategy: PID 20625 died... 07:05:55.236364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20625): Terminated: ok {rc=0} 07:05:55.282726 --- ParallelTerminationStrategy: PID 20628 died... 07:05:55.302562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20628): Terminated: ok {rc=0} 07:05:55.390413 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:05:56.677385 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:56.683402 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:05:56.704071 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:05:56.742270 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:05:56.830329 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:05:56.851442 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:05:56.889755 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:05:57.479215 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:05:57.529226 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:57.539924 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:05:57.596597 tst cs_paging_gprs_active.py: using LAC 39231 07:05:57.719151 tst cs_paging_gprs_active.py: using RAC 216 07:05:57.840634 tst cs_paging_gprs_active.py: using CellId 39231 07:05:57.961512 tst cs_paging_gprs_active.py: using BVCI 39232 07:05:58.073834 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:58.084653 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:58.095334 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:58.105986 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:58.116450 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:58.127165 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:58.137881 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:58.148333 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:05:58.159039 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:05:58.278470 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:05:58.400682 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:05:58.627094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:05:58.963178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20633): Launched 07:05:59.252865 run iperf3-srv_10.42.42.10(pid=20634): Launched 07:05:59.378057 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:05:59.602389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:05:59.937987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20635): Launched 07:06:00.227877 run iperf3-srv_10.42.42.10(pid=20636): Launched 07:06:00.352217 tst cs_paging_gprs_active.py:38: start network... 07:06:00.577299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:01.113465 run create_hlr_db(pid=20637): Launched 07:06:01.283395 bus /gobi_6: Setting Powered False 07:06:02.342077 run create_hlr_db(pid=20637): Terminated: ok {rc=0} 07:06:02.814524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20639): Launched 07:06:03.148051 run osmo-hlr_10.42.42.2(pid=20640): Launched 07:06:03.274060 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:03.808268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20642): Launched 07:06:04.117808 run osmo-stp_10.42.42.5(pid=20643): Launched 07:06:04.234978 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:06:04.769595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20645): Launched 07:06:04.887725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:06:05.151617 run patchelf(pid=20646): Launched 07:06:05.322947 run osmo-stp_10.42.42.5(pid=20643): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20643)] 07:06:05.453753 run osmo-stp_10.42.42.5(pid=20643): stdout: | (launched: 2022-12-14_07:06:04.059547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:05.585244 run osmo-stp_10.42.42.5(pid=20643): stderr: | 20221214070604234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070604234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070604234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070604235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070604235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070604235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070604235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:05.716828 run osmo-stp_10.42.42.5(pid=20643): stdout: | (launched: 2022-12-14_07:06:04.059547) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:05.842716 run osmo-stp_10.42.42.5(pid=20643): stderr: | 20221214070604234 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070604234 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070604234 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070604235 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070604235 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070604235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070604235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:05.992275 run patchelf(pid=20646): Terminating (SIGINT) 07:06:06.167111 run patchelf(pid=20646): Terminated: ok {rc=0} 07:06:06.293244 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=20643): Process ended prematurely: osmo-stp_10.42.42.5(pid=20643) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20643)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:06:06.302584 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:06:06.329520 run osmo-hlr_10.42.42.2(pid=20640): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20640)] 07:06:06.376923 run osmo-hlr_10.42.42.2(pid=20640): stdout: | (launched: 2022-12-14_07:06:03.085376) 07:06:06.426016 run osmo-hlr_10.42.42.2(pid=20640): stderr: | 20221214070603288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070603288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070603288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070603288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070603288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070603289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070603301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070603309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070603310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070603310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:06.475183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20633): Terminating (SIGTERM) 07:06:06.514762 run iperf3-srv_10.42.42.10(pid=20634): Terminating (SIGTERM) 07:06:06.554130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20635): Terminating (SIGTERM) 07:06:06.593936 run iperf3-srv_10.42.42.10(pid=20636): Terminating (SIGTERM) 07:06:06.633349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20639): Terminating (SIGTERM) 07:06:06.672912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20642): Terminating (SIGTERM) 07:06:06.712623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20645): Terminating (SIGTERM) 07:06:06.753001 --- ParallelTerminationStrategy: PID 20633 died... 07:06:06.771913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20633): Terminated: ok {rc=0} 07:06:06.815740 --- ParallelTerminationStrategy: PID 20634 died... 07:06:06.834190 run iperf3-srv_10.42.42.10(pid=20634): Terminated {rc=256} 07:06:06.877632 --- ParallelTerminationStrategy: PID 20635 died... 07:06:06.896093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20635): Terminated: ok {rc=0} 07:06:06.939746 --- ParallelTerminationStrategy: PID 20636 died... 07:06:06.958158 run iperf3-srv_10.42.42.10(pid=20636): Terminated {rc=256} 07:06:07.001680 --- ParallelTerminationStrategy: PID 20639 died... 07:06:07.020044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20639): Terminated: ok {rc=0} 07:06:07.063596 --- ParallelTerminationStrategy: PID 20642 died... 07:06:07.082104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20642): Terminated: ok {rc=0} 07:06:07.125675 --- ParallelTerminationStrategy: PID 20645 died... 07:06:07.144192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20645): Terminated: ok {rc=0} 07:06:07.230204 bus /gobi_0: Setting Powered False 07:06:08.331125 bus /gobi_0: Setting Powered False 07:06:09.450828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:06:10.603734 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:10.615925 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:06:10.682232 tst iperf3.py: using LAC 39232 07:06:10.813325 tst iperf3.py: using RAC 217 07:06:10.940818 tst iperf3.py: using CellId 39232 07:06:11.069614 tst iperf3.py: using BVCI 39233 07:06:11.182092 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:11.193375 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:11.204297 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:11.215202 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:11.226303 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:11.237300 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:11.248162 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:11.258907 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:11.269818 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:06:11.385634 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:06:11.593982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:06:11.907237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20647): Launched 07:06:12.179495 run iperf3-srv_10.42.42.10(pid=20648): Launched 07:06:12.295762 tst iperf3.py:8: start network... 07:06:12.502688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:12.983922 run create_hlr_db(pid=20649): Launched 07:06:13.108804 bus /gobi_6: Setting Powered False 07:06:14.169997 run create_hlr_db(pid=20649): Terminated: ok {rc=0} 07:06:14.601231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20651): Launched 07:06:14.912596 run osmo-hlr_10.42.42.2(pid=20652): Launched 07:06:15.030068 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:15.563031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20654): Launched 07:06:15.898298 run osmo-stp_10.42.42.5(pid=20655): Launched 07:06:16.202864 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:06:16.859701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20657): Launched 07:06:16.992196 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:06:17.262565 run patchelf(pid=20658): Launched 07:06:17.436912 run osmo-stp_10.42.42.5(pid=20655): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20655)] 07:06:17.566950 run osmo-stp_10.42.42.5(pid=20655): stdout: | (launched: 2022-12-14_07:06:15.814790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:17.699391 run osmo-stp_10.42.42.5(pid=20655): stderr: | 20221214070616097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070616097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070616097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070616098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070616098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070616098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070616098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:17.831664 run osmo-stp_10.42.42.5(pid=20655): stdout: | (launched: 2022-12-14_07:06:15.814790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:17.957785 run osmo-stp_10.42.42.5(pid=20655): stderr: | 20221214070616097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070616097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070616097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070616098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070616098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070616098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070616098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:18.107062 run patchelf(pid=20658): Terminating (SIGINT) 07:06:18.282024 run patchelf(pid=20658): Terminated: ok {rc=0} 07:06:18.408906 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20655): Process ended prematurely: osmo-stp_10.42.42.5(pid=20655) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20655)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 07:06:18.418541 tst iperf3.py:8: Test FAILED (7.9 sec) 07:06:18.445562 run osmo-hlr_10.42.42.2(pid=20652): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20652)] 07:06:18.492863 run osmo-hlr_10.42.42.2(pid=20652): stdout: | (launched: 2022-12-14_07:06:14.853964) 07:06:18.542281 run osmo-hlr_10.42.42.2(pid=20652): stderr: | 20221214070615034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070615034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070615034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070615034 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070615034 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070615034 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070615049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070615059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070615059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070615059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:18.591869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20647): Terminating (SIGTERM) 07:06:18.632038 run iperf3-srv_10.42.42.10(pid=20648): Terminating (SIGTERM) 07:06:18.672315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20651): Terminating (SIGTERM) 07:06:18.712339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20654): Terminating (SIGTERM) 07:06:18.751862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20657): Terminating (SIGTERM) 07:06:18.791635 --- ParallelTerminationStrategy: PID 20647 died... 07:06:18.810809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20647): Terminated: ok {rc=0} 07:06:18.854731 --- ParallelTerminationStrategy: PID 20648 died... 07:06:18.873210 run iperf3-srv_10.42.42.10(pid=20648): Terminated {rc=256} 07:06:18.916858 --- ParallelTerminationStrategy: PID 20651 died... 07:06:18.935848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20651): Terminated: ok {rc=0} 07:06:18.979308 --- ParallelTerminationStrategy: PID 20654 died... 07:06:18.997818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20654): Terminated: ok {rc=0} 07:06:19.041302 --- ParallelTerminationStrategy: PID 20657 died... 07:06:19.060062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20657): Terminated: ok {rc=0} 07:06:19.146585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:06:20.293543 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:20.305134 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:06:20.362151 tst iperf3m4.py: using LAC 39233 07:06:20.482560 tst iperf3m4.py: using RAC 218 07:06:20.603252 tst iperf3m4.py: using CellId 39233 07:06:20.731794 tst iperf3m4.py: using BVCI 39234 07:06:20.846058 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:20.857072 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:20.867752 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:20.878446 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:20.889094 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:20.899769 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:20.910575 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:20.921183 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:20.932020 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:06:21.055313 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:06:21.176263 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:06:21.297868 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:06:21.416789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:06:21.624426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:06:21.936783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20659): Launched 07:06:22.207266 run iperf3-srv_10.42.42.10(pid=20660): Launched 07:06:22.322455 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:06:22.528448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:06:22.840401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20661): Launched 07:06:23.110942 run iperf3-srv_10.42.42.10(pid=20662): Launched 07:06:23.226345 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:06:23.432823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:06:23.744304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20663): Launched 07:06:24.015582 run iperf3-srv_10.42.42.10(pid=20664): Launched 07:06:24.130934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:06:24.337275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:06:24.648482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20665): Launched 07:06:24.919605 run iperf3-srv_10.42.42.10(pid=20666): Launched 07:06:25.034843 tst iperf3m4.py:8: start network... 07:06:25.240899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:25.719044 run create_hlr_db(pid=20667): Launched 07:06:25.845927 bus /gobi_6: Setting Powered False 07:06:26.906967 run create_hlr_db(pid=20667): Terminated: ok {rc=0} 07:06:27.361008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20669): Launched 07:06:27.696221 run osmo-hlr_10.42.42.2(pid=20670): Launched 07:06:27.823317 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:28.408025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20672): Launched 07:06:28.743507 run osmo-stp_10.42.42.5(pid=20673): Launched 07:06:28.870256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:06:29.446502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20675): Launched 07:06:29.574616 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:06:29.859006 run patchelf(pid=20676): Launched 07:06:30.046150 run osmo-stp_10.42.42.5(pid=20673): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20673)] 07:06:30.186774 run osmo-stp_10.42.42.5(pid=20673): stdout: | (launched: 2022-12-14_07:06:28.680439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:30.329497 run osmo-stp_10.42.42.5(pid=20673): stderr: | 20221214070628878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070628878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070628878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070628879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070628879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070628879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070628879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:30.472206 run osmo-stp_10.42.42.5(pid=20673): stdout: | (launched: 2022-12-14_07:06:28.680439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:30.608170 run osmo-stp_10.42.42.5(pid=20673): stderr: | 20221214070628878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070628878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070628878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070628879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070628879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070628879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070628879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:30.770536 run patchelf(pid=20676): Terminating (SIGINT) 07:06:30.991422 run patchelf(pid=20676): Terminated: ok {rc=0} 07:06:31.131369 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20673): Process ended prematurely: osmo-stp_10.42.42.5(pid=20673) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20673)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:06:31.142682 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:06:31.172800 run osmo-hlr_10.42.42.2(pid=20670): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20670)] 07:06:31.227293 run osmo-hlr_10.42.42.2(pid=20670): stdout: | (launched: 2022-12-14_07:06:27.633479) 07:06:31.281992 run osmo-hlr_10.42.42.2(pid=20670): stderr: | 20221214070627835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070627835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070627835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070627835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070627835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070627835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070627854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070627863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070627863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070627863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:31.337629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20659): Terminating (SIGTERM) 07:06:31.381471 run iperf3-srv_10.42.42.10(pid=20660): Terminating (SIGTERM) 07:06:31.428793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20661): Terminating (SIGTERM) 07:06:31.474006 run iperf3-srv_10.42.42.10(pid=20662): Terminating (SIGTERM) 07:06:31.521425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20663): Terminating (SIGTERM) 07:06:31.566624 run iperf3-srv_10.42.42.10(pid=20664): Terminating (SIGTERM) 07:06:31.613931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20665): Terminating (SIGTERM) 07:06:31.658939 run iperf3-srv_10.42.42.10(pid=20666): Terminating (SIGTERM) 07:06:31.706440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20669): Terminating (SIGTERM) 07:06:31.751082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20672): Terminating (SIGTERM) 07:06:31.795373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20675): Terminating (SIGTERM) 07:06:31.840151 --- ParallelTerminationStrategy: PID 20659 died... 07:06:31.862102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20659): Terminated: ok {rc=0} 07:06:31.911093 --- ParallelTerminationStrategy: PID 20660 died... 07:06:31.932425 run iperf3-srv_10.42.42.10(pid=20660): Terminated {rc=256} 07:06:31.981057 --- ParallelTerminationStrategy: PID 20661 died... 07:06:32.002574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20661): Terminated: ok {rc=0} 07:06:32.051274 --- ParallelTerminationStrategy: PID 20662 died... 07:06:32.072719 run iperf3-srv_10.42.42.10(pid=20662): Terminated {rc=256} 07:06:32.121288 --- ParallelTerminationStrategy: PID 20663 died... 07:06:32.143201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20663): Terminated: ok {rc=0} 07:06:32.190051 --- ParallelTerminationStrategy: PID 20664 died... 07:06:32.209917 run iperf3-srv_10.42.42.10(pid=20664): Terminated {rc=256} 07:06:32.256457 --- ParallelTerminationStrategy: PID 20665 died... 07:06:32.276444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20665): Terminated: ok {rc=0} 07:06:32.323075 --- ParallelTerminationStrategy: PID 20666 died... 07:06:32.343491 run iperf3-srv_10.42.42.10(pid=20666): Terminated {rc=256} 07:06:32.390076 --- ParallelTerminationStrategy: PID 20669 died... 07:06:32.410149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20669): Terminated: ok {rc=0} 07:06:32.456728 --- ParallelTerminationStrategy: PID 20672 died... 07:06:32.476734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20672): Terminated: ok {rc=0} 07:06:32.523451 --- ParallelTerminationStrategy: PID 20675 died... 07:06:32.543903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20675): Terminated: ok {rc=0} 07:06:32.633304 bus /gobi_4: Setting Powered False 07:06:33.732711 bus /gobi_4: Setting Powered False 07:06:34.849132 bus /gobi_1: Setting Powered False 07:06:35.948163 bus /gobi_1: Setting Powered False 07:06:37.064325 bus /gobi_0: Setting Powered False 07:06:38.162692 bus /gobi_0: Setting Powered False 07:06:39.282029 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:06:40.384248 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:40.396239 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:06:40.453544 tst ping.py: using LAC 39234 07:06:40.584102 tst ping.py: using RAC 219 07:06:40.712662 tst ping.py: using CellId 39234 07:06:40.843081 tst ping.py: using BVCI 39235 07:06:40.964086 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:40.975966 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:40.987218 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:40.998667 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:41.010197 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:41.021715 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:41.033470 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:41.044880 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:06:41.161720 tst ping.py:19: start network... 07:06:41.365923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:41.837748 run create_hlr_db(pid=20677): Launched 07:06:41.961516 bus /gobi_6: Setting Powered False 07:06:43.021706 run create_hlr_db(pid=20677): Terminated: ok {rc=0} 07:06:43.470519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20679): Launched 07:06:43.800003 run osmo-hlr_10.42.42.2(pid=20680): Launched 07:06:43.924210 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:44.496340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20682): Launched 07:06:44.825007 run osmo-stp_10.42.42.5(pid=20683): Launched 07:06:44.949710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:06:45.515793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20685): Launched 07:06:45.640202 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:06:45.929587 run patchelf(pid=20686): Launched 07:06:46.133180 run osmo-stp_10.42.42.5(pid=20683): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20683)] 07:06:46.267215 run osmo-stp_10.42.42.5(pid=20683): stdout: | (launched: 2022-12-14_07:06:44.763343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:46.401948 run osmo-stp_10.42.42.5(pid=20683): stderr: | 20221214070644958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070644958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070644958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070644958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070644959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070644959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070644959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:46.535536 run osmo-stp_10.42.42.5(pid=20683): stdout: | (launched: 2022-12-14_07:06:44.763343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:46.664650 run osmo-stp_10.42.42.5(pid=20683): stderr: | 20221214070644958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070644958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070644958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070644958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070644959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070644959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070644959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:46.814641 run patchelf(pid=20686): Terminating (SIGINT) 07:06:46.991362 run patchelf(pid=20686): Terminated: ok {rc=0} 07:06:47.118860 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=20683): Process ended prematurely: osmo-stp_10.42.42.5(pid=20683) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20683)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 07:06:47.128238 tst ping.py:22: Test FAILED (6.7 sec) 07:06:47.155917 run osmo-hlr_10.42.42.2(pid=20680): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20680)] 07:06:47.205946 run osmo-hlr_10.42.42.2(pid=20680): stdout: | (launched: 2022-12-14_07:06:43.738221) 07:06:47.256039 run osmo-hlr_10.42.42.2(pid=20680): stderr: | 20221214070643942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070643942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070643942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070643942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070643942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070643942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070643954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070643962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070643962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070643962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:47.306273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20679): Terminating (SIGTERM) 07:06:47.346643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20682): Terminating (SIGTERM) 07:06:47.387075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20685): Terminating (SIGTERM) 07:06:47.427557 --- ParallelTerminationStrategy: PID 20679 died... 07:06:47.446991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20679): Terminated: ok {rc=0} 07:06:47.491304 --- ParallelTerminationStrategy: PID 20682 died... 07:06:47.510102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20682): Terminated: ok {rc=0} 07:06:47.554318 --- ParallelTerminationStrategy: PID 20685 died... 07:06:47.573144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20685): Terminated: ok {rc=0} 07:06:47.657405 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:06:48.743824 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:48.756092 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:06:48.816074 tst ping_idle_ping.py: using LAC 39235 07:06:48.945992 tst ping_idle_ping.py: using RAC 220 07:06:49.081251 tst ping_idle_ping.py: using CellId 39235 07:06:49.209293 tst ping_idle_ping.py: using BVCI 39236 07:06:49.329858 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:49.341496 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:49.352745 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:49.364032 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:49.375642 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:49.387360 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:49.399173 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:06:49.410765 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:06:49.528411 tst ping_idle_ping.py:24: start network... 07:06:49.751508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:50.263477 run create_hlr_db(pid=20687): Launched 07:06:50.387954 bus /gobi_6: Setting Powered False 07:06:51.452276 run create_hlr_db(pid=20687): Terminated: ok {rc=0} 07:06:51.911920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20689): Launched 07:06:52.242294 run osmo-hlr_10.42.42.2(pid=20690): Launched 07:06:52.367568 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:52.937240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20692): Launched 07:06:53.267017 run osmo-stp_10.42.42.5(pid=20693): Launched 07:06:53.392415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:06:53.960688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20695): Launched 07:06:54.086661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:06:54.366259 run patchelf(pid=20696): Launched 07:06:54.548388 run osmo-stp_10.42.42.5(pid=20693): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20693)] 07:06:54.687631 run osmo-stp_10.42.42.5(pid=20693): stdout: | (launched: 2022-12-14_07:06:53.205303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:54.828438 run osmo-stp_10.42.42.5(pid=20693): stderr: | 20221214070653401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070653401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070653401 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070653402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070653402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070653402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070653402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:54.969247 run osmo-stp_10.42.42.5(pid=20693): stdout: | (launched: 2022-12-14_07:06:53.205303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:55.103350 run osmo-stp_10.42.42.5(pid=20693): stderr: | 20221214070653401 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070653401 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070653401 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070653402 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070653402 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070653402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070653402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:55.262506 run patchelf(pid=20696): Terminating (SIGINT) 07:06:55.447885 run patchelf(pid=20696): Terminated: ok {rc=0} 07:06:55.581392 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=20693): Process ended prematurely: osmo-stp_10.42.42.5(pid=20693) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20693)] [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:06:55.590934 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:06:55.618805 run osmo-hlr_10.42.42.2(pid=20690): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20690)] 07:06:55.669664 run osmo-hlr_10.42.42.2(pid=20690): stdout: | (launched: 2022-12-14_07:06:52.180446) 07:06:55.722509 run osmo-hlr_10.42.42.2(pid=20690): stderr: | 20221214070652381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070652381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070652381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070652381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070652381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070652381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070652393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070652401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070652402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070652402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:55.775554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20689): Terminating (SIGTERM) 07:06:55.817800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20692): Terminating (SIGTERM) 07:06:55.860096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20695): Terminating (SIGTERM) 07:06:55.902601 --- ParallelTerminationStrategy: PID 20689 died... 07:06:55.923231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20689): Terminated: ok {rc=0} 07:06:55.969914 --- ParallelTerminationStrategy: PID 20692 died... 07:06:55.990005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20692): Terminated: ok {rc=0} 07:06:56.036694 --- ParallelTerminationStrategy: PID 20695 died... 07:06:56.056789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20695): Terminated: ok {rc=0} 07:06:56.145108 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:06:57.433737 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:06:57.440614 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:06:57.461584 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:06:57.496241 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:06:57.548757 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:06:57.569955 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:06:57.605058 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:06:58.163877 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:06:58.169612 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:06:58.181357 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:06:58.241791 tst switch_tch_pdch.py: using LAC 39236 07:06:58.364408 tst switch_tch_pdch.py: using RAC 221 07:06:58.485001 tst switch_tch_pdch.py: using CellId 39236 07:06:58.604742 tst switch_tch_pdch.py: using BVCI 39237 07:06:58.715853 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:06:58.727183 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:06:58.738230 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:06:58.749209 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:06:58.760053 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:06:58.771049 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:06:58.782247 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:06:58.793228 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:06:58.914664 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:06:59.033565 tst switch_tch_pdch.py:51: start network... 07:06:59.237125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:59.708202 run create_hlr_db(pid=20700): Launched 07:06:59.831154 bus /gobi_6: Setting Powered False 07:07:00.910296 run create_hlr_db(pid=20700): Terminated: ok {rc=0} 07:07:01.400727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20702): Launched 07:07:01.827950 run osmo-hlr_10.42.42.2(pid=20703): Launched 07:07:02.093308 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:02.760791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20705): Launched 07:07:03.088371 run osmo-stp_10.42.42.5(pid=20706): Launched 07:07:03.212073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:07:03.777419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20708): Launched 07:07:03.903248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:07:04.182035 run patchelf(pid=20709): Launched 07:07:04.363502 run osmo-stp_10.42.42.5(pid=20706): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20706)] 07:07:04.501988 run osmo-stp_10.42.42.5(pid=20706): stdout: | (launched: 2022-12-14_07:07:03.026937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:04.641683 run osmo-stp_10.42.42.5(pid=20706): stderr: | 20221214070703222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070703222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070703222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070703223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070703223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070703223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070703223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:04.781999 run osmo-stp_10.42.42.5(pid=20706): stdout: | (launched: 2022-12-14_07:07:03.026937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:04.915287 run osmo-stp_10.42.42.5(pid=20706): stderr: | 20221214070703222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070703222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070703222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070703223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070703223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070703223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070703223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:05.073206 run patchelf(pid=20709): Terminating (SIGINT) 07:07:05.257321 run patchelf(pid=20709): Terminated: ok {rc=0} 07:07:05.389865 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20706): Process ended prematurely: osmo-stp_10.42.42.5(pid=20706) [trial-2401↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20706)] [trial-2401↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:07:05.399277 tst switch_tch_pdch.py:54: Test FAILED (7.2 sec) 07:07:05.427284 run osmo-hlr_10.42.42.2(pid=20703): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20703)] 07:07:05.478314 run osmo-hlr_10.42.42.2(pid=20703): stdout: | (launched: 2022-12-14_07:07:01.749975) 07:07:05.530982 run osmo-hlr_10.42.42.2(pid=20703): stderr: | 20221214070702059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070702059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070702060 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070702060 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070702060 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070702060 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070702078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070702104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070702105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070702105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:05.583765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20702): Terminating (SIGTERM) 07:07:05.626050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20705): Terminating (SIGTERM) 07:07:05.668526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20708): Terminating (SIGTERM) 07:07:05.711715 --- ParallelTerminationStrategy: PID 20702 died... 07:07:05.732551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20702): Terminated: ok {rc=0} 07:07:05.779408 --- ParallelTerminationStrategy: PID 20705 died... 07:07:05.799491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20705): Terminated: ok {rc=0} 07:07:05.846328 --- ParallelTerminationStrategy: PID 20708 died... 07:07:05.866450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20708): Terminated: ok {rc=0} 07:07:05.955852 bus /gobi_0: Setting Powered False 07:07:07.054030 bus /gobi_0: Setting Powered False 07:07:08.170098 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:07:09.411954 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:09.418306 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:07:09.439547 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:07:09.475653 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:07:09.529655 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:07:09.550941 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:07:09.586125 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:07:10.141638 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:07:10.147087 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:07:10.158583 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:07:10.216494 tst switch_tch_pdch.py: using LAC 39237 07:07:10.346286 tst switch_tch_pdch.py: using RAC 222 07:07:10.476554 tst switch_tch_pdch.py: using CellId 39237 07:07:10.606660 tst switch_tch_pdch.py: using BVCI 39238 07:07:10.728531 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:07:10.740434 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:07:10.752070 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:07:10.763310 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:07:10.774893 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:07:10.786573 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:07:10.798372 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:07:10.810180 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:07:10.929046 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:07:11.048622 tst switch_tch_pdch.py:51: start network... 07:07:11.253660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:11.699847 run create_hlr_db(pid=20714): Launched 07:07:11.824567 bus /gobi_6: Setting Powered False 07:07:12.885806 run create_hlr_db(pid=20714): Terminated: ok {rc=0} 07:07:13.288235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20716): Launched 07:07:13.593899 run osmo-hlr_10.42.42.2(pid=20717): Launched 07:07:13.709439 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:14.228895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20719): Launched 07:07:14.533945 run osmo-stp_10.42.42.5(pid=20720): Launched 07:07:14.650984 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:07:15.150709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20722): Launched 07:07:15.266710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:07:15.525990 run patchelf(pid=20723): Launched 07:07:15.695635 run osmo-stp_10.42.42.5(pid=20720): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20720)] 07:07:15.830566 run osmo-stp_10.42.42.5(pid=20720): stdout: | (launched: 2022-12-14_07:07:14.476175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:15.979816 run osmo-stp_10.42.42.5(pid=20720): stderr: | 20221214070714649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070714649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070714649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070714650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070714650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070714650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070714650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:16.114067 run osmo-stp_10.42.42.5(pid=20720): stdout: | (launched: 2022-12-14_07:07:14.476175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:16.242226 run osmo-stp_10.42.42.5(pid=20720): stderr: | 20221214070714649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070714649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070714649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070714650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070714650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070714650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070714650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:16.393960 run patchelf(pid=20723): Terminating (SIGINT) 07:07:16.571552 run patchelf(pid=20723): Terminated: ok {rc=0} 07:07:16.699254 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=20720): Process ended prematurely: osmo-stp_10.42.42.5(pid=20720) [trial-2401↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20720)] [trial-2401↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:07:16.709487 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 07:07:16.737090 run osmo-hlr_10.42.42.2(pid=20717): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20717)] 07:07:16.786766 run osmo-hlr_10.42.42.2(pid=20717): stdout: | (launched: 2022-12-14_07:07:13.535826) 07:07:16.837136 run osmo-hlr_10.42.42.2(pid=20717): stderr: | 20221214070713717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070713717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070713717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070713717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070713717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070713717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070713729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070713738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070713738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070713738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:16.887410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20716): Terminating (SIGTERM) 07:07:16.929225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20719): Terminating (SIGTERM) 07:07:16.971962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20722): Terminating (SIGTERM) 07:07:17.013625 --- ParallelTerminationStrategy: PID 20716 died... 07:07:17.034506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20716): Terminated: ok {rc=0} 07:07:17.079962 --- ParallelTerminationStrategy: PID 20719 died... 07:07:17.099889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20719): Terminated: ok {rc=0} 07:07:17.145158 --- ParallelTerminationStrategy: PID 20722 died... 07:07:17.164326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20722): Terminated: ok {rc=0} 07:07:17.250277 bus /gobi_0: Setting Powered False 07:07:18.348134 bus /gobi_0: Setting Powered False 07:07:19.466361 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_sms:oc2g --------------------------------------------------------------------- 07:07:20.700817 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:20.704839 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 07:07:20.725101 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 07:07:20.732197 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 07:07:20.782555 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 07:07:20.802885 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 07:07:20.809590 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 07:07:21.347251 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 07:07:21.352098 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 07:07:21.362806 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 07:07:21.396250 tst mo_mt_sms.py: using LAC 39238 07:07:21.517861 tst mo_mt_sms.py: using RAC 223 07:07:21.637142 tst mo_mt_sms.py: using CellId 39238 07:07:21.754953 tst mo_mt_sms.py: using BVCI 39239 07:07:21.866064 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 07:07:21.986581 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 07:07:22.105276 tst mo_mt_sms.py:9: start nitb and bts... 07:07:22.327108 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:07:22.993816 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20727): Launched 07:07:23.326417 run osmo-nitb_10.42.42.2(pid=20728): Launched 07:07:23.507356 run osmo-nitb_10.42.42.2(pid=20728): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20728)] 07:07:23.653692 run osmo-nitb_10.42.42.2(pid=20728): stdout: | (launched: 2022-12-14_07:07:23.264304) 07:07:23.802194 run osmo-nitb_10.42.42.2(pid=20728): stderr: | (launched: 2022-12-14_07:07:23.313432) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:07:23.949899 run osmo-nitb_10.42.42.2(pid=20728): stdout: | (launched: 2022-12-14_07:07:23.264304) 07:07:24.091420 run osmo-nitb_10.42.42.2(pid=20728): stderr: | (launched: 2022-12-14_07:07:23.313432) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20728): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20728) [trial-2401↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20728)] 07:07:24.450085 tst osmo-nitb_10.42.42.2(pid=20728): stdout: | (launched: 2022-12-14_07:07:23.264304) 07:07:24.582996 tst osmo-nitb_10.42.42.2(pid=20728): stderr: | (launched: 2022-12-14_07:07:23.313432) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:07:24.739815 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=20728): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20728) [trial-2401↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20728)] [trial-2401↪nitb_sms:oc2g↪mo_mt_sms.py:11] 07:07:24.748568 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:07:24.755812 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20727): Terminating (SIGTERM) 07:07:24.967315 --- ParallelTerminationStrategy: PID 20727 died... 07:07:24.989193 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20727): Terminated: ok {rc=0} 07:07:25.078328 bus /sierra_3: Setting Powered False 07:07:26.177751 bus /sierra_3: Setting Powered False 07:07:27.295444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 sms:oc2g --------------------------------------------------------------------- 07:07:28.478652 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:28.483170 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 07:07:28.504354 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 07:07:28.534360 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 07:07:28.589746 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 07:07:28.610231 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 07:07:28.636872 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 07:07:29.177839 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 sms:oc2g mo_mt_sms.py ---------------------------------------------- 07:07:29.182939 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:07:29.193748 tst sms:oc2g: Using 1 x bts (candidates: 1) 07:07:29.226901 tst mo_mt_sms.py: using LAC 39239 07:07:29.344118 tst mo_mt_sms.py: using RAC 224 07:07:29.460736 tst mo_mt_sms.py: using CellId 39239 07:07:29.577924 tst mo_mt_sms.py: using BVCI 39240 07:07:29.686922 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:07:29.697592 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:07:29.708012 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:07:29.718449 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:07:29.728805 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:07:29.739152 tst sms:oc2g: Using 1 x modem (candidates: 2) 07:07:29.860215 tst sms:oc2g: Using 1 x modem (candidates: 2) 07:07:29.976405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:30.450522 run create_hlr_db(pid=20732): Launched 07:07:30.575301 bus /sierra_2: Setting Powered False 07:07:31.634818 run create_hlr_db(pid=20732): Terminated: ok {rc=0} 07:07:32.072572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20734): Launched 07:07:32.391309 run osmo-hlr_10.42.42.2(pid=20735): Launched 07:07:32.506367 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:33.033623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20737): Launched 07:07:33.342088 run osmo-stp_10.42.42.5(pid=20738): Launched 07:07:33.456723 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:34.006288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20740): Launched 07:07:34.312897 run osmo-msc_10.42.42.6(pid=20741): Launched 07:07:34.482536 run osmo-stp_10.42.42.5(pid=20738): ERR: Terminated: ERROR {rc=1} [trial-2401↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20738)] 07:07:34.611512 run osmo-stp_10.42.42.5(pid=20738): stdout: | (launched: 2022-12-14_07:07:33.283282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:34.739610 run osmo-stp_10.42.42.5(pid=20738): stderr: | 20221214070733458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070733458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070733458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070733458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070733459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070733459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070733459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:34.865407 run osmo-stp_10.42.42.5(pid=20738): stdout: | (launched: 2022-12-14_07:07:33.283282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:34.985491 run osmo-stp_10.42.42.5(pid=20738): stderr: | 20221214070733458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070733458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070733458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070733458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070733459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070733459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070733459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:35.130228 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=20738): Process ended prematurely: osmo-stp_10.42.42.5(pid=20738) [trial-2401↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20738)] [trial-2401↪sms:oc2g↪mo_mt_sms.py:16] 07:07:35.138634 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 07:07:35.165052 run osmo-hlr_10.42.42.2(pid=20735): ERR: Terminated: ERROR {rc=237} [trial-2401↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20735)] 07:07:35.212889 run osmo-hlr_10.42.42.2(pid=20735): stdout: | (launched: 2022-12-14_07:07:32.333349) 07:07:35.262176 run osmo-hlr_10.42.42.2(pid=20735): stderr: | 20221214070732510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070732510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070732510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070732510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070732510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070732510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070732523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070732532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070732532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070732533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:35.331578 run osmo-msc_10.42.42.6(pid=20741): ERR: Terminated: ERROR {rc=2} [trial-2401↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20741)] 07:07:35.379173 run osmo-msc_10.42.42.6(pid=20741): stdout: | (launched: 2022-12-14_07:07:34.254723) 07:07:35.428376 run osmo-msc_10.42.42.6(pid=20741): stderr: | 20221214070734527 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070734527 DLGLOBAL DEBUG validating counter group 0x7f685c591c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070734527 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070734527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070734527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070734528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070734529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070734530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070734530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070734530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:35.477756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20734): Terminating (SIGTERM) 07:07:35.517854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20737): Terminating (SIGTERM) 07:07:35.557738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20740): Terminating (SIGTERM) 07:07:35.598225 --- ParallelTerminationStrategy: PID 20734 died... 07:07:35.617503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20734): Terminated: ok {rc=0} 07:07:35.661912 --- ParallelTerminationStrategy: PID 20737 died... 07:07:35.680501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20737): Terminated: ok {rc=0} 07:07:35.724854 --- ParallelTerminationStrategy: PID 20740 died... 07:07:35.743717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20740): Terminated: ok {rc=0} 07:07:35.829276 bus /sierra_3: Setting Powered False 07:07:36.928680 bus /sierra_3: Setting Powered False 07:07:38.044614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_ussd:oc2g --------------------------------------------------------------------- 07:07:39.256550 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:39.260112 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 07:07:39.280486 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 07:07:39.287223 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 07:07:39.322410 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 07:07:39.343876 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 07:07:39.350585 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 07:07:39.872131 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 07:07:39.877877 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 07:07:39.889202 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 07:07:39.922966 tst assert_extension.py: using LAC 39240 07:07:40.043765 tst assert_extension.py: using RAC 225 07:07:40.165098 tst assert_extension.py: using CellId 39240 07:07:40.288718 tst assert_extension.py: using BVCI 39241 07:07:40.399694 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 07:07:40.520139 tst assert_extension.py:10: start nitb and bts... 07:07:40.744374 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:07:41.414326 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20746): Launched 07:07:41.746006 run osmo-nitb_10.42.42.2(pid=20747): Launched 07:07:41.929226 run osmo-nitb_10.42.42.2(pid=20747): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20747)] 07:07:42.075730 run osmo-nitb_10.42.42.2(pid=20747): stdout: | (launched: 2022-12-14_07:07:41.683817) 07:07:42.223341 run osmo-nitb_10.42.42.2(pid=20747): stderr: | (launched: 2022-12-14_07:07:41.733038) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:07:42.371077 run osmo-nitb_10.42.42.2(pid=20747): stdout: | (launched: 2022-12-14_07:07:41.683817) 07:07:42.512622 run osmo-nitb_10.42.42.2(pid=20747): stderr: | (launched: 2022-12-14_07:07:41.733038) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=20747): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20747) [trial-2401↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20747)] 07:07:42.871848 tst osmo-nitb_10.42.42.2(pid=20747): stdout: | (launched: 2022-12-14_07:07:41.683817) 07:07:43.004153 tst osmo-nitb_10.42.42.2(pid=20747): stderr: | (launched: 2022-12-14_07:07:41.733038) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:07:43.160840 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=20747): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20747) [trial-2401↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20747)] [trial-2401↪nitb_ussd:oc2g↪assert_extension.py:12] 07:07:43.169796 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:07:43.176841 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20746): Terminating (SIGTERM) 07:07:43.388416 --- ParallelTerminationStrategy: PID 20746 died... 07:07:43.410071 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=20746): Terminated: ok {rc=0} 07:07:43.498179 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 ussd:oc2g --------------------------------------------------------------------- 07:07:44.660508 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:44.664664 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 07:07:44.686003 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 07:07:44.714779 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 07:07:44.751373 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 07:07:44.772765 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 07:07:44.800136 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 07:07:45.334379 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 ussd:oc2g assert_extension.py ---------------------------------------------- 07:07:45.340136 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:07:45.352094 tst ussd:oc2g: Using 1 x bts (candidates: 1) 07:07:45.386897 tst assert_extension.py: using LAC 39241 07:07:45.513838 tst assert_extension.py: using RAC 226 07:07:45.641550 tst assert_extension.py: using CellId 39241 07:07:45.761179 tst assert_extension.py: using BVCI 39242 07:07:45.872237 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:07:45.883281 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:07:45.894247 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:07:45.905203 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:07:45.916104 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:07:45.927598 tst ussd:oc2g: Using 1 x modem (candidates: 1) 07:07:46.063724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:46.590443 run create_hlr_db(pid=20751): Launched 07:07:46.758632 bus /sierra_2: Setting Powered False 07:07:47.823145 run create_hlr_db(pid=20751): Terminated: ok {rc=0} 07:07:48.272652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20753): Launched 07:07:48.578587 run osmo-hlr_10.42.42.2(pid=20754): Launched 07:07:48.694804 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:49.223662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20756): Launched 07:07:49.531303 run osmo-stp_10.42.42.5(pid=20757): Launched 07:07:49.647478 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:50.195243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20759): Launched 07:07:50.500184 run osmo-msc_10.42.42.6(pid=20760): Launched 07:07:50.669641 run osmo-stp_10.42.42.5(pid=20757): ERR: Terminated: ERROR {rc=1} [trial-2401↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20757)] 07:07:50.797097 run osmo-stp_10.42.42.5(pid=20757): stdout: | (launched: 2022-12-14_07:07:49.472691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:50.924462 run osmo-stp_10.42.42.5(pid=20757): stderr: | 20221214070749646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070749646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070749647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070749647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070749648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070749648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070749648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:51.050245 run osmo-stp_10.42.42.5(pid=20757): stdout: | (launched: 2022-12-14_07:07:49.472691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:51.170349 run osmo-stp_10.42.42.5(pid=20757): stderr: | 20221214070749646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070749646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070749647 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070749647 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070749648 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070749648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070749648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:51.314792 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=20757): Process ended prematurely: osmo-stp_10.42.42.5(pid=20757) [trial-2401↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20757)] [trial-2401↪ussd:oc2g↪assert_extension.py:17] 07:07:51.322930 tst assert_extension.py:17: Test FAILED (6.0 sec) 07:07:51.348668 run osmo-hlr_10.42.42.2(pid=20754): ERR: Terminated: ERROR {rc=237} [trial-2401↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20754)] 07:07:51.396150 run osmo-hlr_10.42.42.2(pid=20754): stdout: | (launched: 2022-12-14_07:07:48.520455) 07:07:51.445330 run osmo-hlr_10.42.42.2(pid=20754): stderr: | 20221214070748701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070748701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070748701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070748701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070748701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070748701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070748719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070748729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070748729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070748729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:51.512842 run osmo-msc_10.42.42.6(pid=20760): ERR: Terminated: ERROR {rc=2} [trial-2401↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20760)] 07:07:51.559750 run osmo-msc_10.42.42.6(pid=20760): stdout: | (launched: 2022-12-14_07:07:50.442316) 07:07:51.608265 run osmo-msc_10.42.42.6(pid=20760): stderr: | 20221214070750718 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070750718 DLGLOBAL DEBUG validating counter group 0x7fd636f9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070750718 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070750719 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070750719 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070750719 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070750721 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070750721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070750722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070750722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:51.657355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20753): Terminating (SIGTERM) 07:07:51.696891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20756): Terminating (SIGTERM) 07:07:51.736257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20759): Terminating (SIGTERM) 07:07:51.775836 --- ParallelTerminationStrategy: PID 20753 died... 07:07:51.794757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20753): Terminated: ok {rc=0} 07:07:51.838098 --- ParallelTerminationStrategy: PID 20756 died... 07:07:51.856305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20756): Terminated: ok {rc=0} 07:07:51.899921 --- ParallelTerminationStrategy: PID 20759 died... 07:07:51.918438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20759): Terminated: ok {rc=0} 07:07:52.001772 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:07:53.198126 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:53.205777 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:07:53.226826 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:07:53.253544 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:07:53.307908 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:07:53.330534 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:07:53.358625 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:07:53.901289 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:07:53.951079 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:07:53.962123 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:07:54.017413 tst mo_mt_call.py: using LAC 39242 07:07:54.138524 tst mo_mt_call.py: using RAC 227 07:07:54.261247 tst mo_mt_call.py: using CellId 39242 07:07:54.383651 tst mo_mt_call.py: using BVCI 39243 07:07:54.497173 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:07:54.508199 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:07:54.519020 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:07:54.529921 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:07:54.540800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:07:54.551800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:07:54.667236 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:07:54.790358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:55.308332 run create_hlr_db(pid=20765): Launched 07:07:55.437839 bus /sierra_2: Setting Powered False 07:07:56.503136 run create_hlr_db(pid=20765): Terminated: ok {rc=0} 07:07:56.947366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20767): Launched 07:07:57.259758 run osmo-hlr_10.42.42.2(pid=20768): Launched 07:07:57.378208 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:57.933399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20770): Launched 07:07:58.247126 run osmo-stp_10.42.42.5(pid=20771): Launched 07:07:58.365249 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:58.924870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20773): Launched 07:07:59.236084 run osmo-msc_10.42.42.6(pid=20774): Launched 07:07:59.408804 run osmo-stp_10.42.42.5(pid=20771): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20771)] 07:07:59.539625 run osmo-stp_10.42.42.5(pid=20771): stdout: | (launched: 2022-12-14_07:07:58.187312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:59.669675 run osmo-stp_10.42.42.5(pid=20771): stderr: | 20221214070758363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070758363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070758364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070758364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070758364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070758365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070758365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:59.798024 run osmo-stp_10.42.42.5(pid=20771): stdout: | (launched: 2022-12-14_07:07:58.187312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:59.920007 run osmo-stp_10.42.42.5(pid=20771): stderr: | 20221214070758363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070758363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070758364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070758364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070758364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070758365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070758365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:00.066904 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20771): Process ended prematurely: osmo-stp_10.42.42.5(pid=20771) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20771)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:08:00.075696 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:08:00.101909 run osmo-hlr_10.42.42.2(pid=20768): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20768)] 07:08:00.149185 run osmo-hlr_10.42.42.2(pid=20768): stdout: | (launched: 2022-12-14_07:07:57.200615) 07:08:00.198174 run osmo-hlr_10.42.42.2(pid=20768): stderr: | 20221214070757381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070757381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070757382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070757382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070757382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070757382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070757394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070757404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070757404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070757404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:00.266504 run osmo-msc_10.42.42.6(pid=20774): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20774)] 07:08:00.313754 run osmo-msc_10.42.42.6(pid=20774): stdout: | (launched: 2022-12-14_07:07:59.176820) 07:08:00.362566 run osmo-msc_10.42.42.6(pid=20774): stderr: | 20221214070759452 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070759452 DLGLOBAL DEBUG validating counter group 0x7fec14d36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070759452 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070759452 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070759453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070759453 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070759454 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070759455 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070759455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070759455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:00.411845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20767): Terminating (SIGTERM) 07:08:00.451203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20770): Terminating (SIGTERM) 07:08:00.490456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20773): Terminating (SIGTERM) 07:08:00.530121 --- ParallelTerminationStrategy: PID 20767 died... 07:08:00.548892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20767): Terminated: ok {rc=0} 07:08:00.593310 --- ParallelTerminationStrategy: PID 20770 died... 07:08:00.611815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20770): Terminated: ok {rc=0} 07:08:00.655433 --- ParallelTerminationStrategy: PID 20773 died... 07:08:00.674144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20773): Terminated: ok {rc=0} 07:08:00.760742 bus /sierra_3: Setting Powered False 07:08:01.864624 bus /sierra_3: Setting Powered False 07:08:02.999624 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:08:04.151004 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:08:04.163289 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:08:04.221051 tst mo_mt_call_osmux.py: using LAC 39243 07:08:04.353367 tst mo_mt_call_osmux.py: using RAC 228 07:08:04.487257 tst mo_mt_call_osmux.py: using CellId 39243 07:08:04.618142 tst mo_mt_call_osmux.py: using BVCI 39244 07:08:04.742078 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:08:04.753798 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:08:04.765251 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:08:04.776589 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:08:04.788430 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:08:04.800214 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:08:04.919060 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:08:05.041989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:05.563737 run create_hlr_db(pid=20776): Launched 07:08:05.690716 bus /sierra_2: Setting Powered False 07:08:06.756312 run create_hlr_db(pid=20776): Terminated: ok {rc=0} 07:08:07.202640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20778): Launched 07:08:07.515932 run osmo-hlr_10.42.42.2(pid=20779): Launched 07:08:07.635126 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:08.189442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20781): Launched 07:08:08.503253 run osmo-stp_10.42.42.5(pid=20782): Launched 07:08:08.621140 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:09.180194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20784): Launched 07:08:09.491738 run osmo-msc_10.42.42.6(pid=20785): Launched 07:08:09.665646 run osmo-stp_10.42.42.5(pid=20782): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20782)] 07:08:09.801249 run osmo-stp_10.42.42.5(pid=20782): stdout: | (launched: 2022-12-14_07:08:08.443567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:09.943126 run osmo-stp_10.42.42.5(pid=20782): stderr: | 20221214070808619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070808619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070808620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070808620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070808620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070808621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070808621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:10.071302 run osmo-stp_10.42.42.5(pid=20782): stdout: | (launched: 2022-12-14_07:08:08.443567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:10.193602 run osmo-stp_10.42.42.5(pid=20782): stderr: | 20221214070808619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070808619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070808620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070808620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070808620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070808621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070808621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:10.340454 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20782): Process ended prematurely: osmo-stp_10.42.42.5(pid=20782) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20782)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:08:10.349414 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:08:10.375757 run osmo-hlr_10.42.42.2(pid=20779): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20779)] 07:08:10.423364 run osmo-hlr_10.42.42.2(pid=20779): stdout: | (launched: 2022-12-14_07:08:07.456343) 07:08:10.472364 run osmo-hlr_10.42.42.2(pid=20779): stderr: | 20221214070807637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070807637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070807637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070807637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070807637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070807637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070807649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070807657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070807657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070807657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:10.540694 run osmo-msc_10.42.42.6(pid=20785): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20785)] 07:08:10.587969 run osmo-msc_10.42.42.6(pid=20785): stdout: | (launched: 2022-12-14_07:08:09.432355) 07:08:10.636740 run osmo-msc_10.42.42.6(pid=20785): stderr: | 20221214070809708 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070809708 DLGLOBAL DEBUG validating counter group 0x7fc401449c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070809708 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070809708 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070809708 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070809708 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070809710 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070809711 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070809711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070809711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:10.685957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20778): Terminating (SIGTERM) 07:08:10.725251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20781): Terminating (SIGTERM) 07:08:10.764732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20784): Terminating (SIGTERM) 07:08:10.804352 --- ParallelTerminationStrategy: PID 20778 died... 07:08:10.823527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20778): Terminated: ok {rc=0} 07:08:10.867374 --- ParallelTerminationStrategy: PID 20781 died... 07:08:10.886017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20781): Terminated: ok {rc=0} 07:08:10.930497 --- ParallelTerminationStrategy: PID 20784 died... 07:08:10.949038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20784): Terminated: ok {rc=0} 07:08:11.032414 bus /sierra_3: Setting Powered False 07:08:12.130316 bus /sierra_3: Setting Powered False 07:08:13.246403 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:08:14.480089 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:08:14.487121 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:08:14.508174 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:08:14.536378 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:08:14.590083 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:08:14.611207 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:08:14.638680 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:08:15.186237 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:08:15.236733 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:15.248082 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:08:15.303415 tst mo_mt_call.py: using LAC 39244 07:08:15.426815 tst mo_mt_call.py: using RAC 229 07:08:15.550412 tst mo_mt_call.py: using CellId 39244 07:08:15.672800 tst mo_mt_call.py: using BVCI 39245 07:08:15.785214 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:15.796247 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:15.807133 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:15.818084 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:15.839974 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:15.868282 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:08:16.008525 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:08:16.131308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:16.630596 run create_hlr_db(pid=20790): Launched 07:08:16.793507 bus /sierra_2: Setting Powered False 07:08:17.855352 run create_hlr_db(pid=20790): Terminated: ok {rc=0} 07:08:18.312193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20792): Launched 07:08:18.649639 run osmo-hlr_10.42.42.2(pid=20793): Launched 07:08:18.777620 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:19.356459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20795): Launched 07:08:19.692771 run osmo-stp_10.42.42.5(pid=20796): Launched 07:08:19.819957 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:20.423444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20798): Launched 07:08:20.760038 run osmo-msc_10.42.42.6(pid=20799): Launched 07:08:20.946490 run osmo-stp_10.42.42.5(pid=20796): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20796)] 07:08:21.087526 run osmo-stp_10.42.42.5(pid=20796): stdout: | (launched: 2022-12-14_07:08:19.629693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:21.229123 run osmo-stp_10.42.42.5(pid=20796): stderr: | 20221214070819826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070819826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070819826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070819827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070819827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070819827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070819827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:21.368389 run osmo-stp_10.42.42.5(pid=20796): stdout: | (launched: 2022-12-14_07:08:19.629693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:21.501182 run osmo-stp_10.42.42.5(pid=20796): stderr: | 20221214070819826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070819826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070819826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070819827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070819827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070819827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070819827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:21.660371 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20796): Process ended prematurely: osmo-stp_10.42.42.5(pid=20796) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20796)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:08:21.670123 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 07:08:21.698148 run osmo-hlr_10.42.42.2(pid=20793): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20793)] 07:08:21.749447 run osmo-hlr_10.42.42.2(pid=20793): stdout: | (launched: 2022-12-14_07:08:18.586700) 07:08:21.801506 run osmo-hlr_10.42.42.2(pid=20793): stderr: | 20221214070818792 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070818792 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070818792 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070818792 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070818792 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070818792 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070818804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070818812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070818813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070818813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:21.873916 run osmo-msc_10.42.42.6(pid=20799): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20799)] 07:08:21.923921 run osmo-msc_10.42.42.6(pid=20799): stdout: | (launched: 2022-12-14_07:08:20.696493) 07:08:21.975893 run osmo-msc_10.42.42.6(pid=20799): stderr: | 20221214070821021 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070821021 DLGLOBAL DEBUG validating counter group 0x7f4476e2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070821021 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070821021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070821021 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070821021 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070821023 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070821023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070821023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070821023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:22.028295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20792): Terminating (SIGTERM) 07:08:22.070046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20795): Terminating (SIGTERM) 07:08:22.112171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20798): Terminating (SIGTERM) 07:08:22.154669 --- ParallelTerminationStrategy: PID 20792 died... 07:08:22.175355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20792): Terminated: ok {rc=0} 07:08:22.221909 --- ParallelTerminationStrategy: PID 20795 died... 07:08:22.241818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20795): Terminated: ok {rc=0} 07:08:22.288033 --- ParallelTerminationStrategy: PID 20798 died... 07:08:22.307982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20798): Terminated: ok {rc=0} 07:08:22.396653 bus /sierra_3: Setting Powered False 07:08:23.495055 bus /sierra_3: Setting Powered False 07:08:24.613244 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:08:25.760602 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:25.772444 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:08:25.828482 tst mo_mt_call_osmux.py: using LAC 39245 07:08:25.960856 tst mo_mt_call_osmux.py: using RAC 230 07:08:26.091612 tst mo_mt_call_osmux.py: using CellId 39245 07:08:26.223758 tst mo_mt_call_osmux.py: using BVCI 39246 07:08:26.347236 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:26.358810 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:26.370143 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:26.381493 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:26.393237 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:08:26.404899 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:08:26.523350 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:08:26.650534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:27.172899 run create_hlr_db(pid=20801): Launched 07:08:27.300413 bus /sierra_2: Setting Powered False 07:08:28.366465 run create_hlr_db(pid=20801): Terminated: ok {rc=0} 07:08:28.813367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20803): Launched 07:08:29.128392 run osmo-hlr_10.42.42.2(pid=20804): Launched 07:08:29.246273 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:29.797143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20806): Launched 07:08:30.109184 run osmo-stp_10.42.42.5(pid=20807): Launched 07:08:30.226846 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:30.787941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20809): Launched 07:08:31.144450 run osmo-msc_10.42.42.6(pid=20810): Launched 07:08:31.369265 run osmo-stp_10.42.42.5(pid=20807): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20807)] 07:08:31.550586 run osmo-stp_10.42.42.5(pid=20807): stdout: | (launched: 2022-12-14_07:08:30.049865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:31.683491 run osmo-stp_10.42.42.5(pid=20807): stderr: | 20221214070830226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070830226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070830226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070830226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070830227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070830227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070830227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:31.922914 run osmo-stp_10.42.42.5(pid=20807): stdout: | (launched: 2022-12-14_07:08:30.049865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:32.082992 run osmo-stp_10.42.42.5(pid=20807): stderr: | 20221214070830226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070830226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070830226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070830226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070830227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070830227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070830227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:32.264573 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20807): Process ended prematurely: osmo-stp_10.42.42.5(pid=20807) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20807)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:08:32.274182 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 07:08:32.301217 run osmo-hlr_10.42.42.2(pid=20804): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20804)] 07:08:32.350216 run osmo-hlr_10.42.42.2(pid=20804): stdout: | (launched: 2022-12-14_07:08:29.068639) 07:08:32.400347 run osmo-hlr_10.42.42.2(pid=20804): stderr: | 20221214070829248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070829248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070829248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070829248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070829248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070829248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070829260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070829268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070829268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070829269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:32.470196 run osmo-msc_10.42.42.6(pid=20810): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20810)] 07:08:32.517818 run osmo-msc_10.42.42.6(pid=20810): stdout: | (launched: 2022-12-14_07:08:31.081850) 07:08:32.567099 run osmo-msc_10.42.42.6(pid=20810): stderr: | 20221214070831710 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070831711 DLGLOBAL DEBUG validating counter group 0x7f96642dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070831711 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070831711 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070831711 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070831711 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070831725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070831726 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070831726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070831726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:32.617363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20803): Terminating (SIGTERM) 07:08:32.657043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20806): Terminating (SIGTERM) 07:08:32.696756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20809): Terminating (SIGTERM) 07:08:32.736897 --- ParallelTerminationStrategy: PID 20803 died... 07:08:32.756373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20803): Terminated: ok {rc=0} 07:08:32.800787 --- ParallelTerminationStrategy: PID 20806 died... 07:08:32.819623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20806): Terminated: ok {rc=0} 07:08:32.863656 --- ParallelTerminationStrategy: PID 20809 died... 07:08:32.882568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20809): Terminated: ok {rc=0} 07:08:32.968225 bus /sierra_3: Setting Powered False 07:08:34.068109 bus /sierra_3: Setting Powered False 07:08:35.183916 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:08:36.417863 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:08:36.424202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:08:36.444671 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:08:36.472526 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:08:36.524811 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:08:36.545925 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:08:36.573045 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:08:37.124402 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:08:37.179495 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:37.191091 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:08:37.249459 tst mo_mt_call.py: using LAC 39246 07:08:37.372712 tst mo_mt_call.py: using RAC 231 07:08:37.497101 tst mo_mt_call.py: using CellId 39246 07:08:37.621746 tst mo_mt_call.py: using BVCI 39247 07:08:37.734267 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:37.745673 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:37.756621 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:37.767680 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:37.779267 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:37.790646 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:08:37.912481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:08:38.032427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:38.515852 run create_hlr_db(pid=20815): Launched 07:08:38.641887 bus /sierra_2: Setting Powered False 07:08:39.703747 run create_hlr_db(pid=20815): Terminated: ok {rc=0} 07:08:40.160318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20817): Launched 07:08:40.496850 run osmo-hlr_10.42.42.2(pid=20818): Launched 07:08:40.624247 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:41.171165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20820): Launched 07:08:41.483705 run osmo-stp_10.42.42.5(pid=20821): Launched 07:08:41.601182 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:42.165960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20823): Launched 07:08:42.478208 run osmo-msc_10.42.42.6(pid=20824): Launched 07:08:42.651461 run osmo-stp_10.42.42.5(pid=20821): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20821)] 07:08:42.781959 run osmo-stp_10.42.42.5(pid=20821): stdout: | (launched: 2022-12-14_07:08:41.424670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:42.912414 run osmo-stp_10.42.42.5(pid=20821): stderr: | 20221214070841598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070841599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070841599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070841599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070841600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070841600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070841600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:43.041249 run osmo-stp_10.42.42.5(pid=20821): stdout: | (launched: 2022-12-14_07:08:41.424670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:43.164023 run osmo-stp_10.42.42.5(pid=20821): stderr: | 20221214070841598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070841599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070841599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070841599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070841600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070841600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070841600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:43.311694 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20821): Process ended prematurely: osmo-stp_10.42.42.5(pid=20821) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20821)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:08:43.320678 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:08:43.347227 run osmo-hlr_10.42.42.2(pid=20818): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20818)] 07:08:43.394961 run osmo-hlr_10.42.42.2(pid=20818): stdout: | (launched: 2022-12-14_07:08:40.434237) 07:08:43.444260 run osmo-hlr_10.42.42.2(pid=20818): stderr: | 20221214070840635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070840635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070840635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070840635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070840635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070840635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070840648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070840658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070840658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070840658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:43.512840 run osmo-msc_10.42.42.6(pid=20824): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20824)] 07:08:43.560153 run osmo-msc_10.42.42.6(pid=20824): stdout: | (launched: 2022-12-14_07:08:42.419009) 07:08:43.609178 run osmo-msc_10.42.42.6(pid=20824): stderr: | 20221214070842694 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070842694 DLGLOBAL DEBUG validating counter group 0x7efe0dddac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070842694 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070842694 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070842694 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070842695 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070842696 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070842697 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070842697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070842697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:43.658477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20817): Terminating (SIGTERM) 07:08:43.697817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20820): Terminating (SIGTERM) 07:08:43.737167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20823): Terminating (SIGTERM) 07:08:43.776874 --- ParallelTerminationStrategy: PID 20817 died... 07:08:43.796196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20817): Terminated: ok {rc=0} 07:08:43.840682 --- ParallelTerminationStrategy: PID 20820 died... 07:08:43.859656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20820): Terminated: ok {rc=0} 07:08:43.903553 --- ParallelTerminationStrategy: PID 20823 died... 07:08:43.922455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20823): Terminated: ok {rc=0} 07:08:44.008165 bus /sierra_3: Setting Powered False 07:08:45.107737 bus /sierra_3: Setting Powered False 07:08:46.225251 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:08:47.380338 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:47.392601 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:08:47.451316 tst mo_mt_call_osmux.py: using LAC 39247 07:08:47.582108 tst mo_mt_call_osmux.py: using RAC 232 07:08:47.714190 tst mo_mt_call_osmux.py: using CellId 39247 07:08:47.846952 tst mo_mt_call_osmux.py: using BVCI 39248 07:08:47.970046 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:47.981773 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:47.993104 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:48.004327 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:48.015986 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:08:48.027690 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:08:48.147008 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:08:48.269903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:48.789595 run create_hlr_db(pid=20826): Launched 07:08:48.917592 bus /sierra_2: Setting Powered False 07:08:49.983017 run create_hlr_db(pid=20826): Terminated: ok {rc=0} 07:08:50.427841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20828): Launched 07:08:50.741554 run osmo-hlr_10.42.42.2(pid=20829): Launched 07:08:50.860304 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:51.411530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20831): Launched 07:08:51.723122 run osmo-stp_10.42.42.5(pid=20832): Launched 07:08:51.840590 run osmo-msc_10.42.42.6: Starting osmo-msc 07:08:52.402751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20834): Launched 07:08:52.715524 run osmo-msc_10.42.42.6(pid=20835): Launched 07:08:52.888375 run osmo-stp_10.42.42.5(pid=20832): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20832)] 07:08:53.018645 run osmo-stp_10.42.42.5(pid=20832): stdout: | (launched: 2022-12-14_07:08:51.664344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:53.148735 run osmo-stp_10.42.42.5(pid=20832): stderr: | 20221214070851839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070851839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070851839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070851839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070851840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070851840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070851840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:53.277894 run osmo-stp_10.42.42.5(pid=20832): stdout: | (launched: 2022-12-14_07:08:51.664344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:53.400634 run osmo-stp_10.42.42.5(pid=20832): stderr: | 20221214070851839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070851839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070851839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070851839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070851840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070851840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070851840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:53.548029 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20832): Process ended prematurely: osmo-stp_10.42.42.5(pid=20832) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20832)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:08:53.556852 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:08:53.583616 run osmo-hlr_10.42.42.2(pid=20829): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20829)] 07:08:53.631665 run osmo-hlr_10.42.42.2(pid=20829): stdout: | (launched: 2022-12-14_07:08:50.681350) 07:08:53.681273 run osmo-hlr_10.42.42.2(pid=20829): stderr: | 20221214070850863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070850863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070850863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070850863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070850863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070850863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070850875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070850883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070850883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070850883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:53.750336 run osmo-msc_10.42.42.6(pid=20835): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=20835)] 07:08:53.797846 run osmo-msc_10.42.42.6(pid=20835): stdout: | (launched: 2022-12-14_07:08:52.655723) 07:08:53.847276 run osmo-msc_10.42.42.6(pid=20835): stderr: | 20221214070852935 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070852936 DLGLOBAL DEBUG validating counter group 0x7fe0aceffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070852936 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070852936 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070852936 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070852936 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070852938 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070852938 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070852939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070852939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:08:53.897872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20828): Terminating (SIGTERM) 07:08:53.938164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20831): Terminating (SIGTERM) 07:08:53.977908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20834): Terminating (SIGTERM) 07:08:54.018068 --- ParallelTerminationStrategy: PID 20828 died... 07:08:54.037537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20828): Terminated: ok {rc=0} 07:08:54.081776 --- ParallelTerminationStrategy: PID 20831 died... 07:08:54.100554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20831): Terminated: ok {rc=0} 07:08:54.144837 --- ParallelTerminationStrategy: PID 20834 died... 07:08:54.164213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20834): Terminated: ok {rc=0} 07:08:54.249624 bus /sierra_3: Setting Powered False 07:08:55.351086 bus /sierra_3: Setting Powered False 07:08:56.465349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:08:57.693664 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:08:57.700036 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:08:57.720282 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:08:57.747575 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:08:57.798087 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:08:57.818973 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:08:57.845607 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:08:58.396520 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:08:58.447607 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:08:58.458870 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:08:58.513622 tst mo_mt_call.py: using LAC 39248 07:08:58.641275 tst mo_mt_call.py: using RAC 233 07:08:58.763336 tst mo_mt_call.py: using CellId 39248 07:08:58.898152 tst mo_mt_call.py: using BVCI 39249 07:08:59.020521 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:08:59.032372 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:08:59.043903 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:08:59.055459 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:08:59.067083 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:08:59.078808 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:08:59.197811 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:08:59.323882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:59.844387 run create_hlr_db(pid=20840): Launched 07:08:59.971594 bus /sierra_2: Setting Powered False 07:09:01.036107 run create_hlr_db(pid=20840): Terminated: ok {rc=0} 07:09:01.521192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20843): Launched 07:09:01.961412 run osmo-hlr_10.42.42.2(pid=20879): Launched 07:09:02.138887 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:03.061273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20918): Launched 07:09:03.502215 run osmo-stp_10.42.42.5(pid=20969): Launched 07:09:03.783098 run osmo-msc_10.42.42.6: Starting osmo-msc 07:09:04.571380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21112): Launched 07:09:04.962630 run osmo-msc_10.42.42.6(pid=21118): Launched 07:09:05.346784 run osmo-stp_10.42.42.5(pid=20969): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20969)] 07:09:05.638357 run osmo-stp_10.42.42.5(pid=20969): stdout: | (launched: 2022-12-14_07:09:03.425729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:05.799574 run osmo-stp_10.42.42.5(pid=20969): stderr: | 20221214070903819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070903819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070903819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070903819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070903820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070903820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070903820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:05.942270 run osmo-stp_10.42.42.5(pid=20969): stdout: | (launched: 2022-12-14_07:09:03.425729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:06.078314 run osmo-stp_10.42.42.5(pid=20969): stderr: | 20221214070903819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070903819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070903819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070903819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070903820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070903820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070903820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:06.242534 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=20969): Process ended prematurely: osmo-stp_10.42.42.5(pid=20969) [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20969)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:09:06.253321 tst mo_mt_call.py:8: Test FAILED (7.8 sec) 07:09:06.282859 run osmo-hlr_10.42.42.2(pid=20879): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=20879)] 07:09:06.338044 run osmo-hlr_10.42.42.2(pid=20879): stdout: | (launched: 2022-12-14_07:09:01.884841) 07:09:06.392664 run osmo-hlr_10.42.42.2(pid=20879): stderr: | 20221214070902281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070902281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070902281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070902281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070902281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070902281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070902298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070902317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070902317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070902317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:06.468199 run osmo-msc_10.42.42.6(pid=21118): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21118)] 07:09:06.520767 run osmo-msc_10.42.42.6(pid=21118): stdout: | (launched: 2022-12-14_07:09:04.897797) 07:09:06.575485 run osmo-msc_10.42.42.6(pid=21118): stderr: | 20221214070905401 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070905401 DLGLOBAL DEBUG validating counter group 0x7fcb18000c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070905401 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070905401 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070905402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070905402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070905404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070905404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070905404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070905404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:09:06.630556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20843): Terminating (SIGTERM) 07:09:06.674074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20918): Terminating (SIGTERM) 07:09:06.720432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21112): Terminating (SIGTERM) 07:09:06.767167 --- ParallelTerminationStrategy: PID 20843 died... 07:09:06.789041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20843): Terminated: ok {rc=0} 07:09:06.837799 --- ParallelTerminationStrategy: PID 20918 died... 07:09:06.859332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20918): Terminated: ok {rc=0} 07:09:06.907893 --- ParallelTerminationStrategy: PID 21112 died... 07:09:06.929315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21112): Terminated: ok {rc=0} 07:09:07.021708 bus /sierra_3: Setting Powered False 07:09:08.124395 bus /sierra_3: Setting Powered False 07:09:09.247208 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:09:10.397708 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:09:10.410562 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:09:10.472303 tst mo_mt_call_osmux.py: using LAC 39249 07:09:10.598349 tst mo_mt_call_osmux.py: using RAC 234 07:09:10.721418 tst mo_mt_call_osmux.py: using CellId 39249 07:09:10.847443 tst mo_mt_call_osmux.py: using BVCI 39250 07:09:10.964492 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:09:10.976884 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:09:10.988839 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:09:11.000910 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:09:11.013547 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:09:11.025927 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:09:11.147521 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:09:11.269727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:11.773140 run create_hlr_db(pid=21122): Launched 07:09:11.941673 bus /sierra_2: Setting Powered False 07:09:13.009681 run create_hlr_db(pid=21122): Terminated: ok {rc=0} 07:09:13.493870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21124): Launched 07:09:13.854662 run osmo-hlr_10.42.42.2(pid=21125): Launched 07:09:14.114979 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:14.815146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21127): Launched 07:09:15.166934 run osmo-stp_10.42.42.5(pid=21128): Launched 07:09:15.410381 run osmo-msc_10.42.42.6: Starting osmo-msc 07:09:16.169863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21130): Launched 07:09:16.502408 run osmo-msc_10.42.42.6(pid=21131): Launched 07:09:16.978961 run osmo-stp_10.42.42.5(pid=21128): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21128)] 07:09:17.355067 run osmo-stp_10.42.42.5(pid=21128): stdout: | (launched: 2022-12-14_07:09:15.100206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:17.505424 run osmo-stp_10.42.42.5(pid=21128): stderr: | 20221214070915437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070915437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070915438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070915438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070915438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070915439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070915439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:17.637960 run osmo-stp_10.42.42.5(pid=21128): stdout: | (launched: 2022-12-14_07:09:15.100206) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:17.763686 run osmo-stp_10.42.42.5(pid=21128): stderr: | 20221214070915437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070915437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070915438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070915438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070915438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070915439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070915439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:17.915189 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21128): Process ended prematurely: osmo-stp_10.42.42.5(pid=21128) [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21128)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:09:17.925328 tst mo_mt_call_osmux.py:8: Test FAILED (7.6 sec) 07:09:17.953360 run osmo-hlr_10.42.42.2(pid=21125): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21125)] 07:09:18.003310 run osmo-hlr_10.42.42.2(pid=21125): stdout: | (launched: 2022-12-14_07:09:13.789162) 07:09:18.054185 run osmo-hlr_10.42.42.2(pid=21125): stderr: | 20221214070914105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070914105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070914105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070914105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070914105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070914105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070914163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070914175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070914175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070914176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:18.126124 run osmo-msc_10.42.42.6(pid=21131): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21131)] 07:09:18.175641 run osmo-msc_10.42.42.6(pid=21131): stdout: | (launched: 2022-12-14_07:09:16.440678) 07:09:18.226378 run osmo-msc_10.42.42.6(pid=21131): stderr: | 20221214070916927 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070916928 DLGLOBAL DEBUG validating counter group 0x7fc637cc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070916928 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070916928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070916928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070916928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070916930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070916930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070916930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070916930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:09:18.278061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21124): Terminating (SIGTERM) 07:09:18.319450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21127): Terminating (SIGTERM) 07:09:18.361300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21130): Terminating (SIGTERM) 07:09:18.405857 --- ParallelTerminationStrategy: PID 21124 died... 07:09:18.425990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21124): Terminated: ok {rc=0} 07:09:18.473670 --- ParallelTerminationStrategy: PID 21127 died... 07:09:18.493184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21127): Terminated: ok {rc=0} 07:09:18.538958 --- ParallelTerminationStrategy: PID 21130 died... 07:09:18.558911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21130): Terminated: ok {rc=0} 07:09:18.646744 bus /sierra_3: Setting Powered False 07:09:19.746504 bus /sierra_3: Setting Powered False 07:09:20.870524 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:09:22.110539 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:09:22.117964 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:09:22.140213 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:09:22.171548 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:09:22.225700 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:09:22.247910 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:09:22.276423 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:09:22.828752 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:09:22.882847 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:22.894927 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:09:22.952869 tst mo_mt_call.py: using LAC 39250 07:09:23.079252 tst mo_mt_call.py: using RAC 235 07:09:23.207308 tst mo_mt_call.py: using CellId 39250 07:09:23.334486 tst mo_mt_call.py: using BVCI 39251 07:09:23.452931 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:23.465526 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:23.478086 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:23.490373 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:23.502561 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:23.514795 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:09:23.636890 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:09:23.759408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:24.266484 run create_hlr_db(pid=21137): Launched 07:09:24.435623 bus /sierra_2: Setting Powered False 07:09:25.497786 run create_hlr_db(pid=21137): Terminated: ok {rc=0} 07:09:25.934253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21139): Launched 07:09:26.248002 run osmo-hlr_10.42.42.2(pid=21140): Launched 07:09:26.366325 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:26.920281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21142): Launched 07:09:27.234470 run osmo-stp_10.42.42.5(pid=21143): Launched 07:09:27.353279 run osmo-msc_10.42.42.6: Starting osmo-msc 07:09:27.916338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21145): Launched 07:09:28.230896 run osmo-msc_10.42.42.6(pid=21146): Launched 07:09:28.405320 run osmo-stp_10.42.42.5(pid=21143): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21143)] 07:09:28.536427 run osmo-stp_10.42.42.5(pid=21143): stdout: | (launched: 2022-12-14_07:09:27.175107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:28.667380 run osmo-stp_10.42.42.5(pid=21143): stderr: | 20221214070927348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070927348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070927348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070927349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070927351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070927351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070927351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:28.796315 run osmo-stp_10.42.42.5(pid=21143): stdout: | (launched: 2022-12-14_07:09:27.175107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:28.919163 run osmo-stp_10.42.42.5(pid=21143): stderr: | 20221214070927348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070927348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070927348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070927349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070927351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070927351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070927351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:29.066661 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21143): Process ended prematurely: osmo-stp_10.42.42.5(pid=21143) [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21143)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:09:29.075652 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:09:29.102170 run osmo-hlr_10.42.42.2(pid=21140): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21140)] 07:09:29.149957 run osmo-hlr_10.42.42.2(pid=21140): stdout: | (launched: 2022-12-14_07:09:26.189163) 07:09:29.199054 run osmo-hlr_10.42.42.2(pid=21140): stderr: | 20221214070926367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070926367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070926367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070926367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070926367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070926367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070926378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070926387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070926387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070926387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:29.267660 run osmo-msc_10.42.42.6(pid=21146): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21146)] 07:09:29.315074 run osmo-msc_10.42.42.6(pid=21146): stdout: | (launched: 2022-12-14_07:09:28.171134) 07:09:29.364126 run osmo-msc_10.42.42.6(pid=21146): stderr: | 20221214070928449 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070928449 DLGLOBAL DEBUG validating counter group 0x7f859586cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070928449 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070928449 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070928449 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070928450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070928453 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070928453 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070928454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070928454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:09:29.413351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21139): Terminating (SIGTERM) 07:09:29.452793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21142): Terminating (SIGTERM) 07:09:29.492203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21145): Terminating (SIGTERM) 07:09:29.532222 --- ParallelTerminationStrategy: PID 21139 died... 07:09:29.551451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21139): Terminated: ok {rc=0} 07:09:29.595304 --- ParallelTerminationStrategy: PID 21142 died... 07:09:29.614133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21142): Terminated: ok {rc=0} 07:09:29.657830 --- ParallelTerminationStrategy: PID 21145 died... 07:09:29.676488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21145): Terminated: ok {rc=0} 07:09:29.761623 bus /sierra_3: Setting Powered False 07:09:30.863802 bus /sierra_3: Setting Powered False 07:09:31.988461 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:09:33.135760 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:33.147585 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:09:33.202581 tst mo_mt_call_osmux.py: using LAC 39251 07:09:33.324567 tst mo_mt_call_osmux.py: using RAC 236 07:09:33.460396 tst mo_mt_call_osmux.py: using CellId 39251 07:09:33.591923 tst mo_mt_call_osmux.py: using BVCI 39252 07:09:33.715820 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:33.727630 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:33.739124 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:33.750660 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:33.762467 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:09:33.774599 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:09:33.896893 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:09:34.018514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:34.540500 run create_hlr_db(pid=21148): Launched 07:09:34.667451 bus /sierra_2: Setting Powered False 07:09:35.732673 run create_hlr_db(pid=21148): Terminated: ok {rc=0} 07:09:36.178393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21150): Launched 07:09:36.491886 run osmo-hlr_10.42.42.2(pid=21151): Launched 07:09:36.611009 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:37.147380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21153): Launched 07:09:37.460305 run osmo-stp_10.42.42.5(pid=21154): Launched 07:09:37.578887 run osmo-msc_10.42.42.6: Starting osmo-msc 07:09:38.141109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21156): Launched 07:09:38.454170 run osmo-msc_10.42.42.6(pid=21157): Launched 07:09:38.630655 run osmo-stp_10.42.42.5(pid=21154): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21154)] 07:09:38.761575 run osmo-stp_10.42.42.5(pid=21154): stdout: | (launched: 2022-12-14_07:09:37.400491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:38.892642 run osmo-stp_10.42.42.5(pid=21154): stderr: | 20221214070937576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070937577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070937577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070937577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070937578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070937578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070937578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:39.021273 run osmo-stp_10.42.42.5(pid=21154): stdout: | (launched: 2022-12-14_07:09:37.400491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:39.143764 run osmo-stp_10.42.42.5(pid=21154): stderr: | 20221214070937576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070937577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070937577 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070937577 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070937578 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070937578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070937578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:39.290627 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21154): Process ended prematurely: osmo-stp_10.42.42.5(pid=21154) [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21154)] [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:09:39.299493 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:09:39.326121 run osmo-hlr_10.42.42.2(pid=21151): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21151)] 07:09:39.374090 run osmo-hlr_10.42.42.2(pid=21151): stdout: | (launched: 2022-12-14_07:09:36.432623) 07:09:39.423703 run osmo-hlr_10.42.42.2(pid=21151): stderr: | 20221214070936614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070936614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070936614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070936614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070936615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070936615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070936659 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070936668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070936669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070936669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:39.492940 run osmo-msc_10.42.42.6(pid=21157): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21157)] 07:09:39.540795 run osmo-msc_10.42.42.6(pid=21157): stdout: | (launched: 2022-12-14_07:09:38.394989) 07:09:39.590101 run osmo-msc_10.42.42.6(pid=21157): stderr: | 20221214070938670 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070938670 DLGLOBAL DEBUG validating counter group 0x7fd4e5f2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070938671 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070938671 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070938671 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070938671 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070938673 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070938673 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070938673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070938673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:09:39.639646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21150): Terminating (SIGTERM) 07:09:39.679183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21153): Terminating (SIGTERM) 07:09:39.718856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21156): Terminating (SIGTERM) 07:09:39.759145 --- ParallelTerminationStrategy: PID 21150 died... 07:09:39.778615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21150): Terminated: ok {rc=0} 07:09:39.823007 --- ParallelTerminationStrategy: PID 21153 died... 07:09:39.841857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21153): Terminated: ok {rc=0} 07:09:39.886046 --- ParallelTerminationStrategy: PID 21156 died... 07:09:39.904932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21156): Terminated: ok {rc=0} 07:09:39.987653 bus /sierra_3: Setting Powered False 07:09:41.083454 bus /sierra_3: Setting Powered False 07:09:42.197706 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:09:43.434563 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:09:43.441365 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:09:43.462132 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:09:43.489557 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:09:43.541025 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:09:43.561832 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:09:43.588691 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:09:44.138341 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:09:44.189352 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:44.200516 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:09:44.257954 tst mo_mt_call.py: using LAC 39252 07:09:44.381368 tst mo_mt_call.py: using RAC 237 07:09:44.503764 tst mo_mt_call.py: using CellId 39252 07:09:44.628264 tst mo_mt_call.py: using BVCI 39253 07:09:44.742939 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:44.754258 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:44.765321 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:44.776129 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:44.787494 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:44.799179 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:09:44.922130 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:09:45.039539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:45.522574 run create_hlr_db(pid=21163): Launched 07:09:45.651872 bus /sierra_2: Setting Powered False 07:09:46.713211 run create_hlr_db(pid=21163): Terminated: ok {rc=0} 07:09:47.199563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21165): Launched 07:09:47.521376 run osmo-hlr_10.42.42.2(pid=21166): Launched 07:09:47.640765 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:48.179001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21168): Launched 07:09:48.493422 run osmo-stp_10.42.42.5(pid=21169): Launched 07:09:48.612710 run osmo-msc_10.42.42.6: Starting osmo-msc 07:09:49.177395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21171): Launched 07:09:49.493357 run osmo-msc_10.42.42.6(pid=21172): Launched 07:09:49.667896 run osmo-stp_10.42.42.5(pid=21169): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21169)] 07:09:49.799758 run osmo-stp_10.42.42.5(pid=21169): stdout: | (launched: 2022-12-14_07:09:48.434181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:49.931021 run osmo-stp_10.42.42.5(pid=21169): stderr: | 20221214070948605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070948605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070948606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070948606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070948606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070948607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070948607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:50.060291 run osmo-stp_10.42.42.5(pid=21169): stdout: | (launched: 2022-12-14_07:09:48.434181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:50.183676 run osmo-stp_10.42.42.5(pid=21169): stderr: | 20221214070948605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070948605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070948606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070948606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070948606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070948607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070948607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:50.331196 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21169): Process ended prematurely: osmo-stp_10.42.42.5(pid=21169) [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21169)] [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:09:50.340204 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:09:50.367342 run osmo-hlr_10.42.42.2(pid=21166): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21166)] 07:09:50.415382 run osmo-hlr_10.42.42.2(pid=21166): stdout: | (launched: 2022-12-14_07:09:47.462515) 07:09:50.465252 run osmo-hlr_10.42.42.2(pid=21166): stderr: | 20221214070947639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070947639 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070947639 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070947639 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070947639 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070947639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070947651 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070947659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070947660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070947660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:50.534521 run osmo-msc_10.42.42.6(pid=21172): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21172)] 07:09:50.582453 run osmo-msc_10.42.42.6(pid=21172): stdout: | (launched: 2022-12-14_07:09:49.433463) 07:09:50.631721 run osmo-msc_10.42.42.6(pid=21172): stderr: | 20221214070949706 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070949706 DLGLOBAL DEBUG validating counter group 0x7f77ec1a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070949706 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070949706 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070949707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070949707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070949709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070949709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070949709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070949709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:09:50.681471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21165): Terminating (SIGTERM) 07:09:50.721417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21168): Terminating (SIGTERM) 07:09:50.761490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21171): Terminating (SIGTERM) 07:09:50.801822 --- ParallelTerminationStrategy: PID 21165 died... 07:09:50.821247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21165): Terminated: ok {rc=0} 07:09:50.865736 --- ParallelTerminationStrategy: PID 21168 died... 07:09:50.884416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21168): Terminated: ok {rc=0} 07:09:50.928886 --- ParallelTerminationStrategy: PID 21171 died... 07:09:50.948148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21171): Terminated: ok {rc=0} 07:09:51.031851 bus /sierra_3: Setting Powered False 07:09:52.130492 bus /sierra_3: Setting Powered False 07:09:53.250846 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:09:54.399181 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:54.411051 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:09:54.468232 tst mo_mt_call_osmux.py: using LAC 39253 07:09:54.592867 tst mo_mt_call_osmux.py: using RAC 238 07:09:54.715883 tst mo_mt_call_osmux.py: using CellId 39253 07:09:54.840206 tst mo_mt_call_osmux.py: using BVCI 39254 07:09:54.954002 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:54.965285 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:54.976195 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:54.987155 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:54.998162 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:09:55.009307 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:09:55.132652 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:09:55.253583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:55.776170 run create_hlr_db(pid=21174): Launched 07:09:55.904710 bus /sierra_2: Setting Powered False 07:09:56.970391 run create_hlr_db(pid=21174): Terminated: ok {rc=0} 07:09:57.416593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21176): Launched 07:09:57.729822 run osmo-hlr_10.42.42.2(pid=21177): Launched 07:09:57.847471 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:58.401135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21179): Launched 07:09:58.714169 run osmo-stp_10.42.42.5(pid=21180): Launched 07:09:58.831964 run osmo-msc_10.42.42.6: Starting osmo-msc 07:09:59.394212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21182): Launched 07:09:59.707103 run osmo-msc_10.42.42.6(pid=21183): Launched 07:09:59.879129 run osmo-stp_10.42.42.5(pid=21180): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21180)] 07:10:00.008819 run osmo-stp_10.42.42.5(pid=21180): stdout: | (launched: 2022-12-14_07:09:58.655105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:00.138942 run osmo-stp_10.42.42.5(pid=21180): stderr: | 20221214070958829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070958829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070958829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070958829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070958830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070958830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070958830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:00.267676 run osmo-stp_10.42.42.5(pid=21180): stdout: | (launched: 2022-12-14_07:09:58.655105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:00.390677 run osmo-stp_10.42.42.5(pid=21180): stderr: | 20221214070958829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214070958829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214070958829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214070958829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214070958830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214070958830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214070958830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:00.538427 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21180): Process ended prematurely: osmo-stp_10.42.42.5(pid=21180) [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21180)] [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:10:00.547380 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:10:00.573851 run osmo-hlr_10.42.42.2(pid=21177): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21177)] 07:10:00.621593 run osmo-hlr_10.42.42.2(pid=21177): stdout: | (launched: 2022-12-14_07:09:57.670897) 07:10:00.671096 run osmo-hlr_10.42.42.2(pid=21177): stderr: | 20221214070957848 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214070957848 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214070957848 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214070957848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214070957848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214070957848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214070957861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214070957869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214070957869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214070957869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:00.740035 run osmo-msc_10.42.42.6(pid=21183): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21183)] 07:10:00.787202 run osmo-msc_10.42.42.6(pid=21183): stdout: | (launched: 2022-12-14_07:09:59.647860) 07:10:00.841099 run osmo-msc_10.42.42.6(pid=21183): stderr: | 20221214070959921 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214070959922 DLGLOBAL DEBUG validating counter group 0x7ff35d817c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214070959922 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214070959922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214070959922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214070959922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214070959924 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214070959924 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214070959924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214070959924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:10:00.913887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21176): Terminating (SIGTERM) 07:10:00.962845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21179): Terminating (SIGTERM) 07:10:01.009882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21182): Terminating (SIGTERM) 07:10:01.057486 --- ParallelTerminationStrategy: PID 21176 died... 07:10:01.079751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21176): Terminated: ok {rc=0} 07:10:01.136273 --- ParallelTerminationStrategy: PID 21179 died... 07:10:01.158490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21179): Terminated: ok {rc=0} 07:10:01.209445 --- ParallelTerminationStrategy: PID 21182 died... 07:10:01.230881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21182): Terminated: ok {rc=0} 07:10:01.324677 bus /sierra_3: Setting Powered False 07:10:02.420852 bus /sierra_3: Setting Powered False 07:10:03.536215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:10:04.775871 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:10:04.782569 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:10:04.804713 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:10:04.834055 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:10:04.888919 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:10:04.909648 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:10:04.935999 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:10:05.485928 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:10:05.541028 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:05.552548 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:10:05.610737 tst mo_mt_call.py: using LAC 39254 07:10:05.743888 tst mo_mt_call.py: using RAC 239 07:10:05.875905 tst mo_mt_call.py: using CellId 39254 07:10:06.009201 tst mo_mt_call.py: using BVCI 39255 07:10:06.131358 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:06.142985 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:06.154325 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:06.165655 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:06.177389 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:06.188814 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:10:06.307238 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:10:06.430107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:06.953037 run create_hlr_db(pid=21191): Launched 07:10:07.080614 bus /sierra_2: Setting Powered False 07:10:08.146247 run create_hlr_db(pid=21191): Terminated: ok {rc=0} 07:10:08.594831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21193): Launched 07:10:08.907909 run osmo-hlr_10.42.42.2(pid=21194): Launched 07:10:09.025445 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:09.560731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21196): Launched 07:10:09.874212 run osmo-stp_10.42.42.5(pid=21197): Launched 07:10:09.992103 run osmo-msc_10.42.42.6: Starting osmo-msc 07:10:10.556707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21199): Launched 07:10:10.896901 run osmo-msc_10.42.42.6(pid=21200): Launched 07:10:11.082974 run osmo-stp_10.42.42.5(pid=21197): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21197)] 07:10:11.223872 run osmo-stp_10.42.42.5(pid=21197): stdout: | (launched: 2022-12-14_07:10:09.815082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:11.365921 run osmo-stp_10.42.42.5(pid=21197): stderr: | 20221214071009986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071009986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071009986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071009987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071009987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071009987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071009987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:11.505683 run osmo-stp_10.42.42.5(pid=21197): stdout: | (launched: 2022-12-14_07:10:09.815082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:11.639036 run osmo-stp_10.42.42.5(pid=21197): stderr: | 20221214071009986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071009986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071009986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071009987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071009987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071009987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071009987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:11.799082 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21197): Process ended prematurely: osmo-stp_10.42.42.5(pid=21197) [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21197)] [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:10:11.808793 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:10:11.837025 run osmo-hlr_10.42.42.2(pid=21194): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21194)] 07:10:11.888561 run osmo-hlr_10.42.42.2(pid=21194): stdout: | (launched: 2022-12-14_07:10:08.848919) 07:10:11.941135 run osmo-hlr_10.42.42.2(pid=21194): stderr: | 20221214071009023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071009023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071009023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071009023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071009023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071009023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071009040 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071009049 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071009050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071009050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:12.013587 run osmo-msc_10.42.42.6(pid=21200): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21200)] 07:10:12.063444 run osmo-msc_10.42.42.6(pid=21200): stdout: | (launched: 2022-12-14_07:10:10.833464) 07:10:12.115780 run osmo-msc_10.42.42.6(pid=21200): stderr: | 20221214071011154 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071011154 DLGLOBAL DEBUG validating counter group 0x7f505c51ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071011154 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071011154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071011154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071011155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071011157 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071011158 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071011158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071011158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:10:12.168191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21193): Terminating (SIGTERM) 07:10:12.209870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21196): Terminating (SIGTERM) 07:10:12.252211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21199): Terminating (SIGTERM) 07:10:12.295052 --- ParallelTerminationStrategy: PID 21193 died... 07:10:12.315966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21193): Terminated: ok {rc=0} 07:10:12.363229 --- ParallelTerminationStrategy: PID 21196 died... 07:10:12.383613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21196): Terminated: ok {rc=0} 07:10:12.430426 --- ParallelTerminationStrategy: PID 21199 died... 07:10:12.450780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21199): Terminated: ok {rc=0} 07:10:12.540380 bus /sierra_3: Setting Powered False 07:10:13.640843 bus /sierra_3: Setting Powered False 07:10:14.758457 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:10:15.933428 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:15.945608 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:10:16.013334 tst mo_mt_call_osmux.py: using LAC 39255 07:10:16.141174 tst mo_mt_call_osmux.py: using RAC 240 07:10:16.310323 tst mo_mt_call_osmux.py: using CellId 39255 07:10:16.438179 tst mo_mt_call_osmux.py: using BVCI 39256 07:10:16.586663 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:16.599114 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:16.611336 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:16.623914 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:16.636488 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:10:16.650072 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:10:16.786146 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:10:16.929690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:17.508855 run create_hlr_db(pid=21202): Launched 07:10:17.637467 bus /sierra_2: Setting Powered False 07:10:18.699096 run create_hlr_db(pid=21202): Terminated: ok {rc=0} 07:10:19.156543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21204): Launched 07:10:19.493550 run osmo-hlr_10.42.42.2(pid=21205): Launched 07:10:19.622114 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:20.201497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21207): Launched 07:10:20.537901 run osmo-stp_10.42.42.5(pid=21208): Launched 07:10:20.665576 run osmo-msc_10.42.42.6: Starting osmo-msc 07:10:21.275738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21210): Launched 07:10:21.612916 run osmo-msc_10.42.42.6(pid=21211): Launched 07:10:21.799652 run osmo-stp_10.42.42.5(pid=21208): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21208)] 07:10:21.940211 run osmo-stp_10.42.42.5(pid=21208): stdout: | (launched: 2022-12-14_07:10:20.474873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:22.081790 run osmo-stp_10.42.42.5(pid=21208): stderr: | 20221214071020669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071020669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071020669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071020670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071020670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071020670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071020670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:22.221219 run osmo-stp_10.42.42.5(pid=21208): stdout: | (launched: 2022-12-14_07:10:20.474873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:22.354075 run osmo-stp_10.42.42.5(pid=21208): stderr: | 20221214071020669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071020669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071020669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071020670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071020670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071020670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071020670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:22.513704 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21208): Process ended prematurely: osmo-stp_10.42.42.5(pid=21208) [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21208)] [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:10:22.523486 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 07:10:22.551571 run osmo-hlr_10.42.42.2(pid=21205): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21205)] 07:10:22.602677 run osmo-hlr_10.42.42.2(pid=21205): stdout: | (launched: 2022-12-14_07:10:19.430576) 07:10:22.655417 run osmo-hlr_10.42.42.2(pid=21205): stderr: | 20221214071019628 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071019628 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071019628 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071019629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071019629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071019629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071019641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071019649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071019649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071019650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:22.728223 run osmo-msc_10.42.42.6(pid=21211): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21211)] 07:10:22.777984 run osmo-msc_10.42.42.6(pid=21211): stdout: | (launched: 2022-12-14_07:10:21.550332) 07:10:22.831118 run osmo-msc_10.42.42.6(pid=21211): stderr: | 20221214071021871 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071021871 DLGLOBAL DEBUG validating counter group 0x7efe2ca0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071021871 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071021871 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071021871 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071021871 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071021873 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071021873 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071021874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071021874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:10:22.883730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21204): Terminating (SIGTERM) 07:10:22.925556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21207): Terminating (SIGTERM) 07:10:22.967902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21210): Terminating (SIGTERM) 07:10:23.010574 --- ParallelTerminationStrategy: PID 21204 died... 07:10:23.031157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21204): Terminated: ok {rc=0} 07:10:23.077766 --- ParallelTerminationStrategy: PID 21207 died... 07:10:23.097961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21207): Terminated: ok {rc=0} 07:10:23.144356 --- ParallelTerminationStrategy: PID 21210 died... 07:10:23.164518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21210): Terminated: ok {rc=0} 07:10:23.253374 bus /sierra_3: Setting Powered False 07:10:24.352811 bus /sierra_3: Setting Powered False 07:10:25.471872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 emergency:oc2g --------------------------------------------------------------------- 07:10:26.703228 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:10:26.707434 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 07:10:26.727770 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 07:10:26.754376 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 07:10:26.838700 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 07:10:26.858958 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 07:10:26.885095 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 07:10:27.466354 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2401 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 07:10:27.471282 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:27.481963 tst emergency:oc2g: Using 1 x bts (candidates: 1) 07:10:27.517500 tst emergency_mo_mt_call.py: using LAC 39256 07:10:27.640422 tst emergency_mo_mt_call.py: using RAC 241 07:10:27.762364 tst emergency_mo_mt_call.py: using CellId 39256 07:10:27.883960 tst emergency_mo_mt_call.py: using BVCI 39257 07:10:28.004735 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:28.016118 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:28.027097 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:28.038456 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:28.049897 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:28.061244 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:10:28.178764 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:10:28.302475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:28.779685 run create_hlr_db(pid=21219): Launched 07:10:28.904657 bus /sierra_2: Setting Powered False 07:10:29.965418 run create_hlr_db(pid=21219): Terminated: ok {rc=0} 07:10:30.415062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21221): Launched 07:10:30.746134 run osmo-hlr_10.42.42.2(pid=21222): Launched 07:10:30.923910 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:31.581161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21224): Launched 07:10:31.928070 run osmo-stp_10.42.42.5(pid=21225): Launched 07:10:32.194616 tst emergency_mo_mt_call.py: using MSISDN 8562 07:10:32.393262 run osmo-msc_10.42.42.6: Starting osmo-msc 07:10:32.946564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21227): Launched 07:10:33.253325 run osmo-msc_10.42.42.6(pid=21228): Launched 07:10:33.422375 run osmo-stp_10.42.42.5(pid=21225): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21225)] 07:10:33.550110 run osmo-stp_10.42.42.5(pid=21225): stdout: | (launched: 2022-12-14_07:10:31.864736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:33.677754 run osmo-stp_10.42.42.5(pid=21225): stderr: | 20221214071032150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071032150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071032151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071032151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071032152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071032152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071032152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:33.804031 run osmo-stp_10.42.42.5(pid=21225): stdout: | (launched: 2022-12-14_07:10:31.864736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:33.924332 run osmo-stp_10.42.42.5(pid=21225): stderr: | 20221214071032150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071032150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071032151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071032151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071032152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071032152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071032152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:34.068744 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21225): Process ended prematurely: osmo-stp_10.42.42.5(pid=21225) [trial-2401↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21225)] [trial-2401↪emergency:oc2g↪emergency_mo_mt_call.py:19] 07:10:34.077037 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 07:10:34.103189 run osmo-hlr_10.42.42.2(pid=21222): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21222)] 07:10:34.150732 run osmo-hlr_10.42.42.2(pid=21222): stdout: | (launched: 2022-12-14_07:10:30.683929) 07:10:34.200450 run osmo-hlr_10.42.42.2(pid=21222): stderr: | 20221214071030899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071030899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071030899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071030900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071030900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071030900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071030919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071030935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071030935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071030936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:34.269348 run osmo-msc_10.42.42.6(pid=21228): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21228)] 07:10:34.317506 run osmo-msc_10.42.42.6(pid=21228): stdout: | (launched: 2022-12-14_07:10:33.195018) 07:10:34.366829 run osmo-msc_10.42.42.6(pid=21228): stderr: | 20221214071033469 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071033469 DLGLOBAL DEBUG validating counter group 0x7f7b9b56cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071033469 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071033469 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071033470 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071033470 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071033471 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071033472 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071033472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071033472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:10:34.416532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21221): Terminating (SIGTERM) 07:10:34.456168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21224): Terminating (SIGTERM) 07:10:34.495891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21227): Terminating (SIGTERM) 07:10:34.535892 --- ParallelTerminationStrategy: PID 21221 died... 07:10:34.555091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21221): Terminated: ok {rc=0} 07:10:34.599113 --- ParallelTerminationStrategy: PID 21224 died... 07:10:34.617808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21224): Terminated: ok {rc=0} 07:10:34.661748 --- ParallelTerminationStrategy: PID 21227 died... 07:10:34.680401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21227): Terminated: ok {rc=0} 07:10:34.765724 bus /sierra_3: Setting Powered False 07:10:35.864337 bus /sierra_3: Setting Powered False 07:10:36.979422 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 07:10:38.065770 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:38.077690 tst emergency:oc2g: Using 1 x bts (candidates: 1) 07:10:38.116516 tst emergency_preemptive_call.py: using LAC 39257 07:10:38.246626 tst emergency_preemptive_call.py: using RAC 242 07:10:38.376852 tst emergency_preemptive_call.py: using CellId 39257 07:10:38.504772 tst emergency_preemptive_call.py: using BVCI 39258 07:10:38.624314 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:38.635499 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:38.646547 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:38.657623 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:38.668786 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:10:38.679995 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:10:38.800464 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:10:38.923140 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:10:39.041080 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:10:39.159091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:39.634959 run create_hlr_db(pid=21231): Launched 07:10:39.760324 bus /sierra_2: Setting Powered False 07:10:40.821596 run create_hlr_db(pid=21231): Terminated: ok {rc=0} 07:10:41.271190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21233): Launched 07:10:41.602921 run osmo-hlr_10.42.42.2(pid=21234): Launched 07:10:41.728761 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:42.301994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21236): Launched 07:10:42.632400 run osmo-stp_10.42.42.5(pid=21237): Launched 07:10:42.771667 tst emergency_preemptive_call.py: using MSISDN 8563 07:10:42.943149 run osmo-msc_10.42.42.6: Starting osmo-msc 07:10:43.537196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21239): Launched 07:10:43.868659 run osmo-msc_10.42.42.6(pid=21240): Launched 07:10:44.051532 run osmo-stp_10.42.42.5(pid=21237): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21237)] 07:10:44.189680 run osmo-stp_10.42.42.5(pid=21237): stdout: | (launched: 2022-12-14_07:10:42.570413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:44.328282 run osmo-stp_10.42.42.5(pid=21237): stderr: | 20221214071042763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071042763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071042763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071042764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071042764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071042764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071042764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:44.464927 run osmo-stp_10.42.42.5(pid=21237): stdout: | (launched: 2022-12-14_07:10:42.570413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:44.595572 run osmo-stp_10.42.42.5(pid=21237): stderr: | 20221214071042763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071042763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071042763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071042764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071042764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071042764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071042764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:44.752211 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21237): Process ended prematurely: osmo-stp_10.42.42.5(pid=21237) [trial-2401↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21237)] [trial-2401↪emergency:oc2g↪emergency_preemptive_call.py:32] 07:10:44.761354 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 07:10:44.789229 run osmo-hlr_10.42.42.2(pid=21234): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21234)] 07:10:44.840572 run osmo-hlr_10.42.42.2(pid=21234): stdout: | (launched: 2022-12-14_07:10:41.540555) 07:10:44.893271 run osmo-hlr_10.42.42.2(pid=21234): stderr: | 20221214071041737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071041737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071041737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071041737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071041737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071041737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071041749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071041760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071041760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071041761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:44.965860 run osmo-msc_10.42.42.6(pid=21240): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21240)] 07:10:45.015913 run osmo-msc_10.42.42.6(pid=21240): stdout: | (launched: 2022-12-14_07:10:43.805998) 07:10:45.068095 run osmo-msc_10.42.42.6(pid=21240): stderr: | 20221214071044125 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071044125 DLGLOBAL DEBUG validating counter group 0x7fe864ecbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071044126 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071044126 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071044126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071044126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071044128 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071044128 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071044128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071044128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:10:45.120594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21233): Terminating (SIGTERM) 07:10:45.162301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21236): Terminating (SIGTERM) 07:10:45.204327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21239): Terminating (SIGTERM) 07:10:45.246792 --- ParallelTerminationStrategy: PID 21233 died... 07:10:45.267176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21233): Terminated: ok {rc=0} 07:10:45.313847 --- ParallelTerminationStrategy: PID 21236 died... 07:10:45.333785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21236): Terminated: ok {rc=0} 07:10:45.380019 --- ParallelTerminationStrategy: PID 21239 died... 07:10:45.399968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21239): Terminated: ok {rc=0} 07:10:45.487916 bus /sierra_9: Setting Powered False 07:10:46.587376 bus /sierra_9: Setting Powered False 07:10:47.706232 bus /sierra_8: Setting Powered False 07:10:48.805080 bus /sierra_8: Setting Powered False 07:10:49.919769 bus /sierra_3: Setting Powered False 07:10:51.017891 bus /sierra_3: Setting Powered False 07:10:52.133377 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:oc2g --------------------------------------------------------------------- 07:10:53.409972 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:10:53.415635 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 07:10:53.436692 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 07:10:53.476611 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 07:10:53.564330 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 07:10:53.585166 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 07:10:53.623934 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 07:10:54.210006 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 07:10:54.260659 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:10:54.271317 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:10:54.304574 tst cs_paging_gprs_active.py: using LAC 39258 07:10:54.424663 tst cs_paging_gprs_active.py: using RAC 243 07:10:54.545420 tst cs_paging_gprs_active.py: using CellId 39258 07:10:54.665475 tst cs_paging_gprs_active.py: using BVCI 39259 07:10:54.777309 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:10:54.787818 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:10:54.798171 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:10:54.808360 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:10:54.818575 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:10:54.829249 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:10:54.840414 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:10:54.850873 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:10:54.861739 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:10:54.976746 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:10:55.098316 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:10:55.320550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:55.652517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21245): Launched 07:10:55.945412 run iperf3-srv_10.42.42.10(pid=21246): Launched 07:10:56.070677 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:10:56.295867 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:56.632240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21247): Launched 07:10:56.924626 run iperf3-srv_10.42.42.10(pid=21248): Launched 07:10:57.049794 tst cs_paging_gprs_active.py:38: start network... 07:10:57.274590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:57.791747 run create_hlr_db(pid=21249): Launched 07:10:57.919015 bus /sierra_2: Setting Powered False 07:10:58.983768 run create_hlr_db(pid=21249): Terminated: ok {rc=0} 07:10:59.447962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21251): Launched 07:10:59.782299 run osmo-hlr_10.42.42.2(pid=21252): Launched 07:10:59.910315 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:00.492518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21254): Launched 07:11:00.838666 run osmo-stp_10.42.42.5(pid=21255): Launched 07:11:01.181957 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:01.807478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21257): Launched 07:11:01.949669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:02.240571 run patchelf(pid=21258): Launched 07:11:02.428059 run osmo-stp_10.42.42.5(pid=21255): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21255)] 07:11:02.569826 run osmo-stp_10.42.42.5(pid=21255): stdout: | (launched: 2022-12-14_07:11:00.766048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:02.712872 run osmo-stp_10.42.42.5(pid=21255): stderr: | 20221214071101037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071101037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071101037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071101038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071101038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071101038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071101038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:02.856349 run osmo-stp_10.42.42.5(pid=21255): stdout: | (launched: 2022-12-14_07:11:00.766048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:02.993566 run osmo-stp_10.42.42.5(pid=21255): stderr: | 20221214071101037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071101037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071101037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071101038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071101038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071101038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071101038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:03.156197 run patchelf(pid=21258): Terminating (SIGINT) 07:11:03.346498 run patchelf(pid=21258): Terminated: ok {rc=0} 07:11:03.483170 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21255): Process ended prematurely: osmo-stp_10.42.42.5(pid=21255) [trial-2401↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21255)] [trial-2401↪gprs:oc2g↪cs_paging_gprs_active.py:38] 07:11:03.493308 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 07:11:03.522122 run osmo-hlr_10.42.42.2(pid=21252): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21252)] 07:11:03.573177 run osmo-hlr_10.42.42.2(pid=21252): stdout: | (launched: 2022-12-14_07:10:59.719445) 07:11:03.626054 run osmo-hlr_10.42.42.2(pid=21252): stderr: | 20221214071059917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071059917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071059917 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071059917 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071059917 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071059917 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071059929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071059937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071059937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071059938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:03.678897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21245): Terminating (SIGTERM) 07:11:03.721006 run iperf3-srv_10.42.42.10(pid=21246): Terminating (SIGTERM) 07:11:03.763265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21247): Terminating (SIGTERM) 07:11:03.805711 run iperf3-srv_10.42.42.10(pid=21248): Terminating (SIGTERM) 07:11:03.848350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21251): Terminating (SIGTERM) 07:11:03.891059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21254): Terminating (SIGTERM) 07:11:03.933546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21257): Terminating (SIGTERM) 07:11:03.976020 --- ParallelTerminationStrategy: PID 21245 died... 07:11:03.996141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21245): Terminated: ok {rc=0} 07:11:04.042589 --- ParallelTerminationStrategy: PID 21246 died... 07:11:04.062594 run iperf3-srv_10.42.42.10(pid=21246): Terminated {rc=256} 07:11:04.108833 --- ParallelTerminationStrategy: PID 21247 died... 07:11:04.129371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21247): Terminated: ok {rc=0} 07:11:04.175468 --- ParallelTerminationStrategy: PID 21248 died... 07:11:04.195347 run iperf3-srv_10.42.42.10(pid=21248): Terminated {rc=256} 07:11:04.241513 --- ParallelTerminationStrategy: PID 21251 died... 07:11:04.261522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21251): Terminated: ok {rc=0} 07:11:04.307925 --- ParallelTerminationStrategy: PID 21254 died... 07:11:04.328029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21254): Terminated: ok {rc=0} 07:11:04.374332 --- ParallelTerminationStrategy: PID 21257 died... 07:11:04.394390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21257): Terminated: ok {rc=0} 07:11:04.482528 bus /gobi_0: Setting Powered False 07:11:05.581086 bus /gobi_0: Setting Powered False 07:11:06.697645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g iperf3.py ---------------------------------------------- 07:11:07.847685 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:07.859633 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:11:07.896217 tst iperf3.py: using LAC 39259 07:11:08.027597 tst iperf3.py: using RAC 244 07:11:08.158729 tst iperf3.py: using CellId 39259 07:11:08.289734 tst iperf3.py: using BVCI 39260 07:11:08.414125 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:08.425177 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:08.435991 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:08.446939 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:08.458056 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:08.469146 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:08.480258 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:08.491404 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:08.502747 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:11:08.627312 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:11:08.855148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:09.193934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21259): Launched 07:11:09.490385 run iperf3-srv_10.42.42.10(pid=21260): Launched 07:11:09.617821 tst iperf3.py:8: start network... 07:11:09.844423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:10.363982 run create_hlr_db(pid=21261): Launched 07:11:10.491204 bus /gobi_6: Setting Powered False 07:11:11.556688 run create_hlr_db(pid=21261): Terminated: ok {rc=0} 07:11:12.002765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21263): Launched 07:11:12.317062 run osmo-hlr_10.42.42.2(pid=21264): Launched 07:11:12.435931 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:12.970970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21266): Launched 07:11:13.285962 run osmo-stp_10.42.42.5(pid=21267): Launched 07:11:13.403234 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:13.941120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21269): Launched 07:11:14.058701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:14.319996 run patchelf(pid=21270): Launched 07:11:14.493257 run osmo-stp_10.42.42.5(pid=21267): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21267)] 07:11:14.624129 run osmo-stp_10.42.42.5(pid=21267): stdout: | (launched: 2022-12-14_07:11:13.227163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:14.757110 run osmo-stp_10.42.42.5(pid=21267): stderr: | 20221214071113399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071113399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071113399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071113400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071113400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071113400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071113400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:14.890103 run osmo-stp_10.42.42.5(pid=21267): stdout: | (launched: 2022-12-14_07:11:13.227163) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:15.016042 run osmo-stp_10.42.42.5(pid=21267): stderr: | 20221214071113399 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071113399 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071113399 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071113400 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071113400 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071113400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071113400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:15.166664 run patchelf(pid=21270): Terminating (SIGINT) 07:11:15.342307 run patchelf(pid=21270): Terminated: ok {rc=0} 07:11:15.468751 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21267): Process ended prematurely: osmo-stp_10.42.42.5(pid=21267) [trial-2401↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21267)] [trial-2401↪gprs:oc2g↪iperf3.py:8] 07:11:15.478328 tst iperf3.py:8: Test FAILED (7.7 sec) 07:11:15.505313 run osmo-hlr_10.42.42.2(pid=21264): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21264)] 07:11:15.552508 run osmo-hlr_10.42.42.2(pid=21264): stdout: | (launched: 2022-12-14_07:11:12.258078) 07:11:15.601545 run osmo-hlr_10.42.42.2(pid=21264): stderr: | 20221214071112432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071112432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071112432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071112432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071112432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071112432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071112449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071112458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071112458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071112458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:15.651022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21259): Terminating (SIGTERM) 07:11:15.690757 run iperf3-srv_10.42.42.10(pid=21260): Terminating (SIGTERM) 07:11:15.730106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21263): Terminating (SIGTERM) 07:11:15.769761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21266): Terminating (SIGTERM) 07:11:15.809357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21269): Terminating (SIGTERM) 07:11:15.875761 --- ParallelTerminationStrategy: PID 21259 died... 07:11:15.910328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21259): Terminated: ok {rc=0} 07:11:15.961306 --- ParallelTerminationStrategy: PID 21260 died... 07:11:15.981533 run iperf3-srv_10.42.42.10(pid=21260): Terminated {rc=256} 07:11:16.027633 --- ParallelTerminationStrategy: PID 21263 died... 07:11:16.047169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21263): Terminated: ok {rc=0} 07:11:16.091729 --- ParallelTerminationStrategy: PID 21266 died... 07:11:16.111112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21266): Terminated: ok {rc=0} 07:11:16.155905 --- ParallelTerminationStrategy: PID 21269 died... 07:11:16.175329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21269): Terminated: ok {rc=0} 07:11:16.260302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g iperf3m4.py ---------------------------------------------- 07:11:17.409447 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:17.421369 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:11:17.458231 tst iperf3m4.py: using LAC 39260 07:11:17.590409 tst iperf3m4.py: using RAC 245 07:11:17.722390 tst iperf3m4.py: using CellId 39260 07:11:17.858350 tst iperf3m4.py: using BVCI 39261 07:11:17.982617 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:17.993958 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:18.005152 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:18.016262 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:18.027689 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:18.039170 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:18.050877 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:18.062415 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:18.074132 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:11:18.193994 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:11:18.317956 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:11:18.436735 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:11:18.552428 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:11:18.780604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:19.121629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21271): Launched 07:11:19.419249 run iperf3-srv_10.42.42.10(pid=21272): Launched 07:11:19.545751 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:11:19.772936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:20.112203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21273): Launched 07:11:20.406861 run iperf3-srv_10.42.42.10(pid=21274): Launched 07:11:20.524755 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:11:20.732897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:21.047151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21275): Launched 07:11:21.321644 run iperf3-srv_10.42.42.10(pid=21276): Launched 07:11:21.437612 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:11:21.645497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:21.959113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21277): Launched 07:11:22.233646 run iperf3-srv_10.42.42.10(pid=21278): Launched 07:11:22.350585 tst iperf3m4.py:8: start network... 07:11:22.560270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:23.047947 run create_hlr_db(pid=21279): Launched 07:11:23.174943 bus /gobi_6: Setting Powered False 07:11:24.236173 run create_hlr_db(pid=21279): Terminated: ok {rc=0} 07:11:24.692224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21281): Launched 07:11:25.030007 run osmo-hlr_10.42.42.2(pid=21282): Launched 07:11:25.157752 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:25.729253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21284): Launched 07:11:26.065599 run osmo-stp_10.42.42.5(pid=21285): Launched 07:11:26.192183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:26.770829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21287): Launched 07:11:26.900760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:27.183000 run patchelf(pid=21288): Launched 07:11:27.368249 run osmo-stp_10.42.42.5(pid=21285): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21285)] 07:11:27.508900 run osmo-stp_10.42.42.5(pid=21285): stdout: | (launched: 2022-12-14_07:11:26.003789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:27.651557 run osmo-stp_10.42.42.5(pid=21285): stderr: | 20221214071126194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071126194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071126194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071126195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071126195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071126195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071126195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:27.794232 run osmo-stp_10.42.42.5(pid=21285): stdout: | (launched: 2022-12-14_07:11:26.003789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:27.930557 run osmo-stp_10.42.42.5(pid=21285): stderr: | 20221214071126194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071126194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071126194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071126195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071126195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071126195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071126195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:28.091690 run patchelf(pid=21288): Terminating (SIGINT) 07:11:28.280206 run patchelf(pid=21288): Terminated: ok {rc=0} 07:11:28.416188 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21285): Process ended prematurely: osmo-stp_10.42.42.5(pid=21285) [trial-2401↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21285)] [trial-2401↪gprs:oc2g↪iperf3m4.py:8] 07:11:28.426410 tst iperf3m4.py:8: Test FAILED (11.1 sec) 07:11:28.455121 run osmo-hlr_10.42.42.2(pid=21282): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21282)] 07:11:28.505939 run osmo-hlr_10.42.42.2(pid=21282): stdout: | (launched: 2022-12-14_07:11:24.963808) 07:11:28.558179 run osmo-hlr_10.42.42.2(pid=21282): stderr: | 20221214071125174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071125174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071125174 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071125174 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071125174 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071125174 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071125186 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071125194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071125194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071125194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:28.610982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21271): Terminating (SIGTERM) 07:11:28.653271 run iperf3-srv_10.42.42.10(pid=21272): Terminating (SIGTERM) 07:11:28.695615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21273): Terminating (SIGTERM) 07:11:28.738189 run iperf3-srv_10.42.42.10(pid=21274): Terminating (SIGTERM) 07:11:28.780366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21275): Terminating (SIGTERM) 07:11:28.823059 run iperf3-srv_10.42.42.10(pid=21276): Terminating (SIGTERM) 07:11:28.865620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21277): Terminating (SIGTERM) 07:11:28.907917 run iperf3-srv_10.42.42.10(pid=21278): Terminating (SIGTERM) 07:11:28.950173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21281): Terminating (SIGTERM) 07:11:28.992401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21284): Terminating (SIGTERM) 07:11:29.034542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21287): Terminating (SIGTERM) 07:11:29.077189 --- ParallelTerminationStrategy: PID 21271 died... 07:11:29.097904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21271): Terminated: ok {rc=0} 07:11:29.144793 --- ParallelTerminationStrategy: PID 21272 died... 07:11:29.165040 run iperf3-srv_10.42.42.10(pid=21272): Terminated {rc=256} 07:11:29.211430 --- ParallelTerminationStrategy: PID 21273 died... 07:11:29.231372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21273): Terminated: ok {rc=0} 07:11:29.277866 --- ParallelTerminationStrategy: PID 21274 died... 07:11:29.297969 run iperf3-srv_10.42.42.10(pid=21274): Terminated {rc=256} 07:11:29.344506 --- ParallelTerminationStrategy: PID 21275 died... 07:11:29.364677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21275): Terminated: ok {rc=0} 07:11:29.411243 --- ParallelTerminationStrategy: PID 21276 died... 07:11:29.431336 run iperf3-srv_10.42.42.10(pid=21276): Terminated {rc=256} 07:11:29.477941 --- ParallelTerminationStrategy: PID 21277 died... 07:11:29.497906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21277): Terminated: ok {rc=0} 07:11:29.544513 --- ParallelTerminationStrategy: PID 21278 died... 07:11:29.564790 run iperf3-srv_10.42.42.10(pid=21278): Terminated {rc=256} 07:11:29.611340 --- ParallelTerminationStrategy: PID 21281 died... 07:11:29.631480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21281): Terminated: ok {rc=0} 07:11:29.678011 --- ParallelTerminationStrategy: PID 21284 died... 07:11:29.698242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21284): Terminated: ok {rc=0} 07:11:29.744878 --- ParallelTerminationStrategy: PID 21287 died... 07:11:29.765462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21287): Terminated: ok {rc=0} 07:11:29.853323 bus /gobi_4: Setting Powered False 07:11:30.956323 bus /gobi_4: Setting Powered False 07:11:32.098895 bus /gobi_1: Setting Powered False 07:11:33.208722 bus /gobi_1: Setting Powered False 07:11:34.323720 bus /gobi_0: Setting Powered False 07:11:35.423090 bus /gobi_0: Setting Powered False 07:11:36.540191 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g ping.py ---------------------------------------------- 07:11:37.641488 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:37.652403 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:11:37.687258 tst ping.py: using LAC 39261 07:11:37.805933 tst ping.py: using RAC 246 07:11:37.924255 tst ping.py: using CellId 39261 07:11:38.045397 tst ping.py: using BVCI 39262 07:11:38.155326 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:38.165956 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:38.176264 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:38.186591 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:38.196780 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:38.207668 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:38.218071 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:38.228576 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:11:38.344645 tst ping.py:19: start network... 07:11:38.548228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:39.015802 run create_hlr_db(pid=21289): Launched 07:11:39.138485 bus /gobi_6: Setting Powered False 07:11:40.199071 run create_hlr_db(pid=21289): Terminated: ok {rc=0} 07:11:40.645627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21291): Launched 07:11:40.976598 run osmo-hlr_10.42.42.2(pid=21292): Launched 07:11:41.100411 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:41.671756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21294): Launched 07:11:41.999101 run osmo-stp_10.42.42.5(pid=21295): Launched 07:11:42.124188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:42.686006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21297): Launched 07:11:42.811625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:43.088183 run patchelf(pid=21298): Launched 07:11:43.271472 run osmo-stp_10.42.42.5(pid=21295): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21295)] 07:11:43.410780 run osmo-stp_10.42.42.5(pid=21295): stdout: | (launched: 2022-12-14_07:11:41.939152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:43.551621 run osmo-stp_10.42.42.5(pid=21295): stderr: | 20221214071142126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071142126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071142126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071142127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071142127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071142127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071142127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:43.691912 run osmo-stp_10.42.42.5(pid=21295): stdout: | (launched: 2022-12-14_07:11:41.939152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:43.825661 run osmo-stp_10.42.42.5(pid=21295): stderr: | 20221214071142126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071142126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071142126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071142127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071142127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071142127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071142127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:43.984392 run patchelf(pid=21298): Terminating (SIGINT) 07:11:44.169748 run patchelf(pid=21298): Terminated: ok {rc=0} 07:11:44.303000 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21295): Process ended prematurely: osmo-stp_10.42.42.5(pid=21295) [trial-2401↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21295)] [trial-2401↪gprs:oc2g↪ping.py:22] 07:11:44.312638 tst ping.py:22: Test FAILED (6.7 sec) 07:11:44.341368 run osmo-hlr_10.42.42.2(pid=21292): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21292)] 07:11:44.392764 run osmo-hlr_10.42.42.2(pid=21292): stdout: | (launched: 2022-12-14_07:11:40.916303) 07:11:44.445515 run osmo-hlr_10.42.42.2(pid=21292): stderr: | 20221214071141111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071141111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071141111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071141111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071141111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071141111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071141121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071141131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071141131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071141131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:44.498249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21291): Terminating (SIGTERM) 07:11:44.540472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21294): Terminating (SIGTERM) 07:11:44.583185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21297): Terminating (SIGTERM) 07:11:44.626085 --- ParallelTerminationStrategy: PID 21291 died... 07:11:44.646870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21291): Terminated: ok {rc=0} 07:11:44.693777 --- ParallelTerminationStrategy: PID 21294 died... 07:11:44.714023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21294): Terminated: ok {rc=0} 07:11:44.760526 --- ParallelTerminationStrategy: PID 21297 died... 07:11:44.780671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21297): Terminated: ok {rc=0} 07:11:44.869827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 07:11:45.966467 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:45.985748 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:11:46.021477 tst ping_idle_ping.py: using LAC 39262 07:11:46.198355 tst ping_idle_ping.py: using RAC 247 07:11:46.358663 tst ping_idle_ping.py: using CellId 39262 07:11:46.485046 tst ping_idle_ping.py: using BVCI 39263 07:11:46.599969 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:46.611259 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:46.622413 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:46.633554 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:46.644623 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:46.655945 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:46.667319 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:11:46.678556 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:11:46.797177 tst ping_idle_ping.py:24: start network... 07:11:47.013793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:47.506336 run create_hlr_db(pid=21299): Launched 07:11:47.631500 bus /gobi_6: Setting Powered False 07:11:48.693499 run create_hlr_db(pid=21299): Terminated: ok {rc=0} 07:11:49.143052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21301): Launched 07:11:49.472243 run osmo-hlr_10.42.42.2(pid=21302): Launched 07:11:49.596451 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:50.160874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21304): Launched 07:11:50.490767 run osmo-stp_10.42.42.5(pid=21305): Launched 07:11:50.616064 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:51.185953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21307): Launched 07:11:51.312626 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:51.590152 run patchelf(pid=21308): Launched 07:11:51.772141 run osmo-stp_10.42.42.5(pid=21305): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21305)] 07:11:51.911720 run osmo-stp_10.42.42.5(pid=21305): stdout: | (launched: 2022-12-14_07:11:50.430303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:52.052305 run osmo-stp_10.42.42.5(pid=21305): stderr: | 20221214071150619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071150620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071150620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071150620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071150621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071150621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071150621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:52.192707 run osmo-stp_10.42.42.5(pid=21305): stdout: | (launched: 2022-12-14_07:11:50.430303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:52.326358 run osmo-stp_10.42.42.5(pid=21305): stderr: | 20221214071150619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071150620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071150620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071150620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071150621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071150621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071150621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:52.485497 run patchelf(pid=21308): Terminating (SIGINT) 07:11:52.670344 run patchelf(pid=21308): Terminated: ok {rc=0} 07:11:52.803856 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21305): Process ended prematurely: osmo-stp_10.42.42.5(pid=21305) [trial-2401↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21305)] [trial-2401↪gprs:oc2g↪ping_idle_ping.py:27] 07:11:52.813477 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:11:52.841805 run osmo-hlr_10.42.42.2(pid=21302): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21302)] 07:11:52.892196 run osmo-hlr_10.42.42.2(pid=21302): stdout: | (launched: 2022-12-14_07:11:49.411245) 07:11:52.944383 run osmo-hlr_10.42.42.2(pid=21302): stderr: | 20221214071149606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071149606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071149606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071149606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071149606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071149606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071149619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071149628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071149628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071149628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:52.996902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21301): Terminating (SIGTERM) 07:11:53.038601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21304): Terminating (SIGTERM) 07:11:53.081562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21307): Terminating (SIGTERM) 07:11:53.123757 --- ParallelTerminationStrategy: PID 21301 died... 07:11:53.144078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21301): Terminated: ok {rc=0} 07:11:53.191005 --- ParallelTerminationStrategy: PID 21304 died... 07:11:53.210843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21304): Terminated: ok {rc=0} 07:11:53.256711 --- ParallelTerminationStrategy: PID 21307 died... 07:11:53.276519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21307): Terminated: ok {rc=0} 07:11:53.364894 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 07:11:54.656083 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:11:54.661788 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:11:54.682697 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:11:54.722617 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:11:54.810891 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:11:54.831763 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:11:54.871342 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:11:55.460710 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:11:55.510094 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:11:55.520858 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:11:55.557271 tst cs_paging_gprs_active.py: using LAC 39263 07:11:55.677030 tst cs_paging_gprs_active.py: using RAC 248 07:11:55.798369 tst cs_paging_gprs_active.py: using CellId 39263 07:11:55.919014 tst cs_paging_gprs_active.py: using BVCI 39264 07:11:56.030924 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:11:56.041827 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:11:56.052303 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:11:56.062808 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:11:56.073426 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:11:56.083754 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:11:56.095178 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:11:56.106178 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:11:56.117122 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:11:56.239658 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:11:56.359300 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:11:56.581166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:56.910343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21314): Launched 07:11:57.194281 run iperf3-srv_10.42.42.10(pid=21315): Launched 07:11:57.317768 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:11:57.538564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:57.866715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21316): Launched 07:11:58.152400 run iperf3-srv_10.42.42.10(pid=21317): Launched 07:11:58.274650 tst cs_paging_gprs_active.py:38: start network... 07:11:58.494891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:59.001598 run create_hlr_db(pid=21318): Launched 07:11:59.129082 bus /gobi_6: Setting Powered False 07:12:00.189431 run create_hlr_db(pid=21318): Terminated: ok {rc=0} 07:12:00.624593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21320): Launched 07:12:00.938176 run osmo-hlr_10.42.42.2(pid=21321): Launched 07:12:01.183287 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:01.915550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21323): Launched 07:12:02.289191 run osmo-stp_10.42.42.5(pid=21324): Launched 07:12:02.469746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:03.040913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21326): Launched 07:12:03.168381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:03.452727 run patchelf(pid=21327): Launched 07:12:03.624567 run osmo-stp_10.42.42.5(pid=21324): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21324)] 07:12:03.755472 run osmo-stp_10.42.42.5(pid=21324): stdout: | (launched: 2022-12-14_07:12:02.228562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:03.887998 run osmo-stp_10.42.42.5(pid=21324): stderr: | 20221214071202446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071202446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071202447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071202447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071202447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071202448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071202448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:04.020010 run osmo-stp_10.42.42.5(pid=21324): stdout: | (launched: 2022-12-14_07:12:02.228562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:04.146645 run osmo-stp_10.42.42.5(pid=21324): stderr: | 20221214071202446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071202446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071202447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071202447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071202447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071202448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071202448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:04.296093 run patchelf(pid=21327): Terminating (SIGINT) 07:12:04.471447 run patchelf(pid=21327): Terminated: ok {rc=0} 07:12:04.597836 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21324): Process ended prematurely: osmo-stp_10.42.42.5(pid=21324) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21324)] [trial-2401↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:12:04.607327 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 07:12:04.634411 run osmo-hlr_10.42.42.2(pid=21321): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21321)] 07:12:04.682717 run osmo-hlr_10.42.42.2(pid=21321): stdout: | (launched: 2022-12-14_07:12:00.877079) 07:12:04.732628 run osmo-hlr_10.42.42.2(pid=21321): stderr: | 20221214071201185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071201185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071201185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071201185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071201185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071201185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071201198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071201215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071201216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071201216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:04.783190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21314): Terminating (SIGTERM) 07:12:04.823682 run iperf3-srv_10.42.42.10(pid=21315): Terminating (SIGTERM) 07:12:04.863839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21316): Terminating (SIGTERM) 07:12:04.903971 run iperf3-srv_10.42.42.10(pid=21317): Terminating (SIGTERM) 07:12:04.944142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21320): Terminating (SIGTERM) 07:12:04.984425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21323): Terminating (SIGTERM) 07:12:05.024630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21326): Terminating (SIGTERM) 07:12:05.065513 --- ParallelTerminationStrategy: PID 21314 died... 07:12:05.084641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21314): Terminated: ok {rc=0} 07:12:05.129075 --- ParallelTerminationStrategy: PID 21315 died... 07:12:05.147801 run iperf3-srv_10.42.42.10(pid=21315): Terminated {rc=256} 07:12:05.191809 --- ParallelTerminationStrategy: PID 21316 died... 07:12:05.210291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21316): Terminated: ok {rc=0} 07:12:05.254162 --- ParallelTerminationStrategy: PID 21317 died... 07:12:05.272865 run iperf3-srv_10.42.42.10(pid=21317): Terminated {rc=256} 07:12:05.316721 --- ParallelTerminationStrategy: PID 21320 died... 07:12:05.335494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21320): Terminated: ok {rc=0} 07:12:05.379510 --- ParallelTerminationStrategy: PID 21323 died... 07:12:05.398130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21323): Terminated: ok {rc=0} 07:12:05.442633 --- ParallelTerminationStrategy: PID 21326 died... 07:12:05.461657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21326): Terminated: ok {rc=0} 07:12:05.547857 bus /gobi_0: Setting Powered False 07:12:06.650020 bus /gobi_0: Setting Powered False 07:12:07.768055 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:12:08.915083 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:08.926771 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:12:08.964061 tst iperf3.py: using LAC 39264 07:12:09.093752 tst iperf3.py: using RAC 249 07:12:09.213976 tst iperf3.py: using CellId 39264 07:12:09.333978 tst iperf3.py: using BVCI 39265 07:12:09.444291 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:09.455767 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:09.466754 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:09.477726 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:09.488220 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:09.498891 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:09.509608 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:09.520200 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:09.531010 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:12:09.654031 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:12:09.876059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:10.206984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21328): Launched 07:12:10.493072 run iperf3-srv_10.42.42.10(pid=21329): Launched 07:12:10.617764 tst iperf3.py:8: start network... 07:12:10.838646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:11.346813 run create_hlr_db(pid=21330): Launched 07:12:11.472293 bus /gobi_6: Setting Powered False 07:12:12.536844 run create_hlr_db(pid=21330): Terminated: ok {rc=0} 07:12:12.973043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21332): Launched 07:12:13.278348 run osmo-hlr_10.42.42.2(pid=21333): Launched 07:12:13.409618 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:13.978079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21335): Launched 07:12:14.306971 run osmo-stp_10.42.42.5(pid=21336): Launched 07:12:14.433585 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:14.999479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21338): Launched 07:12:15.127255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:15.405294 run patchelf(pid=21339): Launched 07:12:15.589352 run osmo-stp_10.42.42.5(pid=21336): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21336)] 07:12:15.728069 run osmo-stp_10.42.42.5(pid=21336): stdout: | (launched: 2022-12-14_07:12:14.246941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:15.870115 run osmo-stp_10.42.42.5(pid=21336): stderr: | 20221214071214436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071214436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071214437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071214437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071214438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071214438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071214438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:16.015478 run osmo-stp_10.42.42.5(pid=21336): stdout: | (launched: 2022-12-14_07:12:14.246941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:16.153242 run osmo-stp_10.42.42.5(pid=21336): stderr: | 20221214071214436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071214436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071214437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071214437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071214438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071214438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071214438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:16.316631 run patchelf(pid=21339): Terminating (SIGINT) 07:12:16.541910 run patchelf(pid=21339): Terminated: ok {rc=0} 07:12:16.686230 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21336): Process ended prematurely: osmo-stp_10.42.42.5(pid=21336) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21336)] [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 07:12:16.697803 tst iperf3.py:8: Test FAILED (7.8 sec) 07:12:16.727246 run osmo-hlr_10.42.42.2(pid=21333): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21333)] 07:12:16.781620 run osmo-hlr_10.42.42.2(pid=21333): stdout: | (launched: 2022-12-14_07:12:13.221974) 07:12:16.836027 run osmo-hlr_10.42.42.2(pid=21333): stderr: | 20221214071213412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071213412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071213412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071213412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071213412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071213412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071213424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071213432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071213432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071213432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:16.891637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21328): Terminating (SIGTERM) 07:12:16.935378 run iperf3-srv_10.42.42.10(pid=21329): Terminating (SIGTERM) 07:12:16.982522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21332): Terminating (SIGTERM) 07:12:17.027692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21335): Terminating (SIGTERM) 07:12:17.073626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21338): Terminating (SIGTERM) 07:12:17.118564 --- ParallelTerminationStrategy: PID 21328 died... 07:12:17.140120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21328): Terminated: ok {rc=0} 07:12:17.188654 --- ParallelTerminationStrategy: PID 21329 died... 07:12:17.210156 run iperf3-srv_10.42.42.10(pid=21329): Terminated {rc=256} 07:12:17.257405 --- ParallelTerminationStrategy: PID 21332 died... 07:12:17.277449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21332): Terminated: ok {rc=0} 07:12:17.324144 --- ParallelTerminationStrategy: PID 21335 died... 07:12:17.344473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21335): Terminated: ok {rc=0} 07:12:17.391047 --- ParallelTerminationStrategy: PID 21338 died... 07:12:17.411043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21338): Terminated: ok {rc=0} 07:12:17.499708 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:12:18.651437 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:18.663557 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:12:18.701455 tst iperf3m4.py: using LAC 39265 07:12:18.821442 tst iperf3m4.py: using RAC 250 07:12:18.952106 tst iperf3m4.py: using CellId 39265 07:12:19.083856 tst iperf3m4.py: using BVCI 39266 07:12:19.197191 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:19.208074 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:19.218898 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:19.229594 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:19.240169 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:19.250805 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:19.261769 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:19.272325 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:19.283161 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:12:19.405608 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:12:19.528264 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:12:19.648370 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:12:19.764148 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:12:19.970857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:20.281479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21340): Launched 07:12:20.550879 run iperf3-srv_10.42.42.10(pid=21341): Launched 07:12:20.666792 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:12:20.871456 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:21.179044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21342): Launched 07:12:21.447408 run iperf3-srv_10.42.42.10(pid=21343): Launched 07:12:21.562333 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:12:21.766513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:22.074675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21344): Launched 07:12:22.343389 run iperf3-srv_10.42.42.10(pid=21345): Launched 07:12:22.458159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:12:22.662066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:22.970338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21346): Launched 07:12:23.238186 run iperf3-srv_10.42.42.10(pid=21347): Launched 07:12:23.354727 tst iperf3m4.py:8: start network... 07:12:23.558399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:24.033063 run create_hlr_db(pid=21348): Launched 07:12:24.159132 bus /gobi_6: Setting Powered False 07:12:25.219908 run create_hlr_db(pid=21348): Terminated: ok {rc=0} 07:12:25.670729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21350): Launched 07:12:26.003478 run osmo-hlr_10.42.42.2(pid=21351): Launched 07:12:26.130154 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:26.702080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21353): Launched 07:12:27.035048 run osmo-stp_10.42.42.5(pid=21354): Launched 07:12:27.162165 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:27.732269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21356): Launched 07:12:27.862154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:28.142928 run patchelf(pid=21357): Launched 07:12:28.327120 run osmo-stp_10.42.42.5(pid=21354): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21354)] 07:12:28.467051 run osmo-stp_10.42.42.5(pid=21354): stdout: | (launched: 2022-12-14_07:12:26.974395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:28.608573 run osmo-stp_10.42.42.5(pid=21354): stderr: | 20221214071227162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071227162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071227163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071227163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071227164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071227165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071227165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:28.750149 run osmo-stp_10.42.42.5(pid=21354): stdout: | (launched: 2022-12-14_07:12:26.974395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:28.885624 run osmo-stp_10.42.42.5(pid=21354): stderr: | 20221214071227162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071227162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071227163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071227163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071227164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071227165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071227165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:29.045834 run patchelf(pid=21357): Terminating (SIGINT) 07:12:29.232316 run patchelf(pid=21357): Terminated: ok {rc=0} 07:12:29.367281 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21354): Process ended prematurely: osmo-stp_10.42.42.5(pid=21354) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21354)] [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 07:12:29.377671 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:12:29.406477 run osmo-hlr_10.42.42.2(pid=21351): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21351)] 07:12:29.457626 run osmo-hlr_10.42.42.2(pid=21351): stdout: | (launched: 2022-12-14_07:12:25.943156) 07:12:29.510163 run osmo-hlr_10.42.42.2(pid=21351): stderr: | 20221214071226138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071226138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071226138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071226138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071226138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071226138 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071226150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071226159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071226159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071226159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:29.563175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21340): Terminating (SIGTERM) 07:12:29.604915 run iperf3-srv_10.42.42.10(pid=21341): Terminating (SIGTERM) 07:12:29.647464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21342): Terminating (SIGTERM) 07:12:29.690057 run iperf3-srv_10.42.42.10(pid=21343): Terminating (SIGTERM) 07:12:29.732291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21344): Terminating (SIGTERM) 07:12:29.774613 run iperf3-srv_10.42.42.10(pid=21345): Terminating (SIGTERM) 07:12:29.816866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21346): Terminating (SIGTERM) 07:12:29.859573 run iperf3-srv_10.42.42.10(pid=21347): Terminating (SIGTERM) 07:12:29.901939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21350): Terminating (SIGTERM) 07:12:29.944353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21353): Terminating (SIGTERM) 07:12:29.986757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21356): Terminating (SIGTERM) 07:12:30.029174 --- ParallelTerminationStrategy: PID 21340 died... 07:12:30.049560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21340): Terminated: ok {rc=0} 07:12:30.096510 --- ParallelTerminationStrategy: PID 21341 died... 07:12:30.116536 run iperf3-srv_10.42.42.10(pid=21341): Terminated {rc=256} 07:12:30.163059 --- ParallelTerminationStrategy: PID 21342 died... 07:12:30.183020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21342): Terminated: ok {rc=0} 07:12:30.229557 --- ParallelTerminationStrategy: PID 21343 died... 07:12:30.249419 run iperf3-srv_10.42.42.10(pid=21343): Terminated {rc=256} 07:12:30.295837 --- ParallelTerminationStrategy: PID 21344 died... 07:12:30.315939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21344): Terminated: ok {rc=0} 07:12:30.362779 --- ParallelTerminationStrategy: PID 21345 died... 07:12:30.382654 run iperf3-srv_10.42.42.10(pid=21345): Terminated {rc=256} 07:12:30.429132 --- ParallelTerminationStrategy: PID 21346 died... 07:12:30.448925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21346): Terminated: ok {rc=0} 07:12:30.495339 --- ParallelTerminationStrategy: PID 21347 died... 07:12:30.515347 run iperf3-srv_10.42.42.10(pid=21347): Terminated {rc=256} 07:12:30.561708 --- ParallelTerminationStrategy: PID 21350 died... 07:12:30.581643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21350): Terminated: ok {rc=0} 07:12:30.628096 --- ParallelTerminationStrategy: PID 21353 died... 07:12:30.648004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21353): Terminated: ok {rc=0} 07:12:30.694430 --- ParallelTerminationStrategy: PID 21356 died... 07:12:30.714555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21356): Terminated: ok {rc=0} 07:12:30.803475 bus /gobi_4: Setting Powered False 07:12:31.913412 bus /gobi_4: Setting Powered False 07:12:33.040077 bus /gobi_1: Setting Powered False 07:12:34.139631 bus /gobi_1: Setting Powered False 07:12:35.258085 bus /gobi_0: Setting Powered False 07:12:36.357218 bus /gobi_0: Setting Powered False 07:12:37.473645 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 07:12:38.576753 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:38.588319 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:12:38.625143 tst ping.py: using LAC 39266 07:12:38.752608 tst ping.py: using RAC 251 07:12:38.880692 tst ping.py: using CellId 39266 07:12:39.009351 tst ping.py: using BVCI 39267 07:12:39.126626 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:39.138387 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:39.149679 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:39.160885 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:39.172344 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:39.183781 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:39.195490 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:39.207134 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:12:39.323860 tst ping.py:19: start network... 07:12:39.541450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:40.040015 run create_hlr_db(pid=21358): Launched 07:12:40.163552 bus /gobi_6: Setting Powered False 07:12:41.224152 run create_hlr_db(pid=21358): Terminated: ok {rc=0} 07:12:41.645309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21360): Launched 07:12:41.947635 run osmo-hlr_10.42.42.2(pid=21361): Launched 07:12:42.060676 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:42.583158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21363): Launched 07:12:42.884910 run osmo-stp_10.42.42.5(pid=21364): Launched 07:12:43.000220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:43.518495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21366): Launched 07:12:43.635332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:43.890930 run patchelf(pid=21367): Launched 07:12:44.058401 run osmo-stp_10.42.42.5(pid=21364): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21364)] 07:12:44.186596 run osmo-stp_10.42.42.5(pid=21364): stdout: | (launched: 2022-12-14_07:12:42.828932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:44.315968 run osmo-stp_10.42.42.5(pid=21364): stderr: | 20221214071242999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071242999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071242999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071243000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071243000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071243000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071243000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:44.445731 run osmo-stp_10.42.42.5(pid=21364): stdout: | (launched: 2022-12-14_07:12:42.828932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:44.568530 run osmo-stp_10.42.42.5(pid=21364): stderr: | 20221214071242999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071242999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071242999 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071243000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071243000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071243000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071243000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:44.714417 run patchelf(pid=21367): Terminating (SIGINT) 07:12:44.885309 run patchelf(pid=21367): Terminated: ok {rc=0} 07:12:45.008459 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21364): Process ended prematurely: osmo-stp_10.42.42.5(pid=21364) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21364)] [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 07:12:45.017456 tst ping.py:22: Test FAILED (6.4 sec) 07:12:45.044005 run osmo-hlr_10.42.42.2(pid=21361): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21361)] 07:12:45.091412 run osmo-hlr_10.42.42.2(pid=21361): stdout: | (launched: 2022-12-14_07:12:41.892029) 07:12:45.140601 run osmo-hlr_10.42.42.2(pid=21361): stderr: | 20221214071242063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071242063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071242063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071242063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071242063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071242063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071242075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071242086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071242086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071242086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:45.190308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21360): Terminating (SIGTERM) 07:12:45.230168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21363): Terminating (SIGTERM) 07:12:45.270090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21366): Terminating (SIGTERM) 07:12:45.310225 --- ParallelTerminationStrategy: PID 21360 died... 07:12:45.329383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21360): Terminated: ok {rc=0} 07:12:45.373545 --- ParallelTerminationStrategy: PID 21363 died... 07:12:45.392227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21363): Terminated: ok {rc=0} 07:12:45.436195 --- ParallelTerminationStrategy: PID 21366 died... 07:12:45.454726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21366): Terminated: ok {rc=0} 07:12:45.540181 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:12:46.636382 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:46.654123 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:12:46.705089 tst ping_idle_ping.py: using LAC 39267 07:12:46.855833 tst ping_idle_ping.py: using RAC 252 07:12:46.977638 tst ping_idle_ping.py: using CellId 39267 07:12:47.141786 tst ping_idle_ping.py: using BVCI 39268 07:12:47.264784 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:47.276841 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:47.288764 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:47.300765 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:47.313569 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:47.326780 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:47.339082 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:12:47.351314 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:12:47.474673 tst ping_idle_ping.py:24: start network... 07:12:47.694192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:48.200685 run create_hlr_db(pid=21368): Launched 07:12:48.326269 bus /gobi_6: Setting Powered False 07:12:49.391390 run create_hlr_db(pid=21368): Terminated: ok {rc=0} 07:12:49.828480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21370): Launched 07:12:50.133294 run osmo-hlr_10.42.42.2(pid=21371): Launched 07:12:50.247931 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:50.773629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21373): Launched 07:12:51.079548 run osmo-stp_10.42.42.5(pid=21374): Launched 07:12:51.194590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:51.716065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21376): Launched 07:12:51.832677 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:52.088911 run patchelf(pid=21377): Launched 07:12:52.256923 run osmo-stp_10.42.42.5(pid=21374): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21374)] 07:12:52.385530 run osmo-stp_10.42.42.5(pid=21374): stdout: | (launched: 2022-12-14_07:12:51.022783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:52.515479 run osmo-stp_10.42.42.5(pid=21374): stderr: | 20221214071251192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071251192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071251193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071251193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071251193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071251194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071251194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:52.646555 run osmo-stp_10.42.42.5(pid=21374): stdout: | (launched: 2022-12-14_07:12:51.022783) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:52.770108 run osmo-stp_10.42.42.5(pid=21374): stderr: | 20221214071251192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071251192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071251193 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071251193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071251193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071251194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071251194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:52.917290 run patchelf(pid=21377): Terminating (SIGINT) 07:12:53.089188 run patchelf(pid=21377): Terminated: ok {rc=0} 07:12:53.213160 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21374): Process ended prematurely: osmo-stp_10.42.42.5(pid=21374) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21374)] [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 07:12:53.222146 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:12:53.248708 run osmo-hlr_10.42.42.2(pid=21371): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21371)] 07:12:53.296678 run osmo-hlr_10.42.42.2(pid=21371): stdout: | (launched: 2022-12-14_07:12:50.076743) 07:12:53.346017 run osmo-hlr_10.42.42.2(pid=21371): stderr: | 20221214071250251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071250251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071250251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071250251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071250251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071250251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071250263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071250272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071250272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071250272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:53.395703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21370): Terminating (SIGTERM) 07:12:53.435506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21373): Terminating (SIGTERM) 07:12:53.475594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21376): Terminating (SIGTERM) 07:12:53.515701 --- ParallelTerminationStrategy: PID 21370 died... 07:12:53.535216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21370): Terminated: ok {rc=0} 07:12:53.579305 --- ParallelTerminationStrategy: PID 21373 died... 07:12:53.598039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21373): Terminated: ok {rc=0} 07:12:53.641683 --- ParallelTerminationStrategy: PID 21376 died... 07:12:53.660430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21376): Terminated: ok {rc=0} 07:12:53.746583 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:12:55.042450 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:12:55.048459 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:12:55.068817 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:12:55.107496 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:12:55.194458 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:12:55.214890 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:12:55.252527 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:12:55.846004 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:12:55.903899 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:12:55.915402 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:12:55.974894 tst cs_paging_gprs_active.py: using LAC 39268 07:12:56.104335 tst cs_paging_gprs_active.py: using RAC 253 07:12:56.236221 tst cs_paging_gprs_active.py: using CellId 39268 07:12:56.365666 tst cs_paging_gprs_active.py: using BVCI 39269 07:12:56.486253 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:12:56.497824 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:12:56.508892 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:12:56.520106 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:12:56.532001 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:12:56.543950 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:12:56.556045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:12:56.568053 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:12:56.580229 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:12:56.700285 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:12:56.817715 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:12:57.024918 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:57.335537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21381): Launched 07:12:57.605978 run iperf3-srv_10.42.42.10(pid=21382): Launched 07:12:57.722016 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:12:57.930179 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:12:58.241155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21383): Launched 07:12:58.510442 run iperf3-srv_10.42.42.10(pid=21384): Launched 07:12:58.627888 tst cs_paging_gprs_active.py:38: start network... 07:12:58.834924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:59.312553 run create_hlr_db(pid=21385): Launched 07:12:59.438549 bus /gobi_6: Setting Powered False 07:13:00.499788 run create_hlr_db(pid=21385): Terminated: ok {rc=0} 07:13:00.959533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21387): Launched 07:13:01.291061 run osmo-hlr_10.42.42.2(pid=21388): Launched 07:13:01.532045 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:02.213661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21390): Launched 07:13:02.530460 run osmo-stp_10.42.42.5(pid=21391): Launched 07:13:02.649643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:13:03.181778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21393): Launched 07:13:03.300563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:13:03.563913 run patchelf(pid=21394): Launched 07:13:03.735590 run osmo-stp_10.42.42.5(pid=21391): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21391)] 07:13:03.866617 run osmo-stp_10.42.42.5(pid=21391): stdout: | (launched: 2022-12-14_07:13:02.473225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:03.999367 run osmo-stp_10.42.42.5(pid=21391): stderr: | 20221214071302643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071302643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071302643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071302644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071302644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071302644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071302644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:04.131483 run osmo-stp_10.42.42.5(pid=21391): stdout: | (launched: 2022-12-14_07:13:02.473225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:04.257387 run osmo-stp_10.42.42.5(pid=21391): stderr: | 20221214071302643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071302643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071302643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071302644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071302644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071302644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071302644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:04.406856 run patchelf(pid=21394): Terminating (SIGINT) 07:13:04.581854 run patchelf(pid=21394): Terminated: ok {rc=0} 07:13:04.708518 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21391): Process ended prematurely: osmo-stp_10.42.42.5(pid=21391) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21391)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:13:04.717881 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 07:13:04.744581 run osmo-hlr_10.42.42.2(pid=21388): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21388)] 07:13:04.792179 run osmo-hlr_10.42.42.2(pid=21388): stdout: | (launched: 2022-12-14_07:13:01.231958) 07:13:04.841384 run osmo-hlr_10.42.42.2(pid=21388): stderr: | 20221214071301570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071301570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071301570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071301571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071301571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071301571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071301585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071301598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071301598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071301598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:04.891197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21381): Terminating (SIGTERM) 07:13:04.931051 run iperf3-srv_10.42.42.10(pid=21382): Terminating (SIGTERM) 07:13:04.970878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21383): Terminating (SIGTERM) 07:13:05.010813 run iperf3-srv_10.42.42.10(pid=21384): Terminating (SIGTERM) 07:13:05.050644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21387): Terminating (SIGTERM) 07:13:05.090693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21390): Terminating (SIGTERM) 07:13:05.130497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21393): Terminating (SIGTERM) 07:13:05.170436 --- ParallelTerminationStrategy: PID 21381 died... 07:13:05.189740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21381): Terminated: ok {rc=0} 07:13:05.233600 --- ParallelTerminationStrategy: PID 21382 died... 07:13:05.252161 run iperf3-srv_10.42.42.10(pid=21382): Terminated {rc=256} 07:13:05.295714 --- ParallelTerminationStrategy: PID 21383 died... 07:13:05.314259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21383): Terminated: ok {rc=0} 07:13:05.357889 --- ParallelTerminationStrategy: PID 21384 died... 07:13:05.376374 run iperf3-srv_10.42.42.10(pid=21384): Terminated {rc=256} 07:13:05.419960 --- ParallelTerminationStrategy: PID 21387 died... 07:13:05.438765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21387): Terminated: ok {rc=0} 07:13:05.482608 --- ParallelTerminationStrategy: PID 21390 died... 07:13:05.501293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21390): Terminated: ok {rc=0} 07:13:05.545139 --- ParallelTerminationStrategy: PID 21393 died... 07:13:05.563712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21393): Terminated: ok {rc=0} 07:13:05.649723 bus /gobi_0: Setting Powered False 07:13:06.749568 bus /gobi_0: Setting Powered False 07:13:07.864813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:13:09.013096 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:09.024811 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:13:09.084788 tst iperf3.py: using LAC 39269 07:13:09.208631 tst iperf3.py: using RAC 254 07:13:09.331394 tst iperf3.py: using CellId 39269 07:13:09.453375 tst iperf3.py: using BVCI 39270 07:13:09.565451 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:09.576676 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:09.587517 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:09.598371 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:09.608890 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:09.619656 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:09.630670 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:09.641379 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:09.652084 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:13:09.774209 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:13:09.998511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:13:10.330653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21395): Launched 07:13:10.619108 run iperf3-srv_10.42.42.10(pid=21396): Launched 07:13:10.742939 tst iperf3.py:8: start network... 07:13:10.966113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:11.476642 run create_hlr_db(pid=21397): Launched 07:13:11.603264 bus /gobi_6: Setting Powered False 07:13:12.667526 run create_hlr_db(pid=21397): Terminated: ok {rc=0} 07:13:13.109011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21399): Launched 07:13:13.417747 run osmo-hlr_10.42.42.2(pid=21400): Launched 07:13:13.535424 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:14.070596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21402): Launched 07:13:14.378563 run osmo-stp_10.42.42.5(pid=21403): Launched 07:13:14.495799 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:13:15.053993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21405): Launched 07:13:15.182542 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:13:15.461837 run patchelf(pid=21406): Launched 07:13:15.633762 run osmo-stp_10.42.42.5(pid=21403): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21403)] 07:13:15.764023 run osmo-stp_10.42.42.5(pid=21403): stdout: | (launched: 2022-12-14_07:13:14.321214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:15.910770 run osmo-stp_10.42.42.5(pid=21403): stderr: | 20221214071314489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071314489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071314489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071314490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071314490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071314490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071314490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:16.061047 run osmo-stp_10.42.42.5(pid=21403): stdout: | (launched: 2022-12-14_07:13:14.321214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:16.202207 run osmo-stp_10.42.42.5(pid=21403): stderr: | 20221214071314489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071314489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071314489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071314490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071314490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071314490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071314490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:16.371438 run patchelf(pid=21406): Terminating (SIGINT) 07:13:16.563880 run patchelf(pid=21406): Terminated: ok {rc=0} 07:13:16.704693 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21403): Process ended prematurely: osmo-stp_10.42.42.5(pid=21403) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21403)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 07:13:16.716123 tst iperf3.py:8: Test FAILED (7.7 sec) 07:13:16.747033 run osmo-hlr_10.42.42.2(pid=21400): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21400)] 07:13:16.801717 run osmo-hlr_10.42.42.2(pid=21400): stdout: | (launched: 2022-12-14_07:13:13.360307) 07:13:16.857065 run osmo-hlr_10.42.42.2(pid=21400): stderr: | 20221214071313533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071313533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071313533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071313533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071313533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071313533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071313546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071313554 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071313554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071313554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:16.913672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21395): Terminating (SIGTERM) 07:13:16.958699 run iperf3-srv_10.42.42.10(pid=21396): Terminating (SIGTERM) 07:13:17.005894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21399): Terminating (SIGTERM) 07:13:17.051117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21402): Terminating (SIGTERM) 07:13:17.098242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21405): Terminating (SIGTERM) 07:13:17.144297 --- ParallelTerminationStrategy: PID 21395 died... 07:13:17.166876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21395): Terminated: ok {rc=0} 07:13:17.215173 --- ParallelTerminationStrategy: PID 21396 died... 07:13:17.235738 run iperf3-srv_10.42.42.10(pid=21396): Terminated {rc=256} 07:13:17.283055 --- ParallelTerminationStrategy: PID 21399 died... 07:13:17.303121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21399): Terminated: ok {rc=0} 07:13:17.349937 --- ParallelTerminationStrategy: PID 21402 died... 07:13:17.370002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21402): Terminated: ok {rc=0} 07:13:17.416782 --- ParallelTerminationStrategy: PID 21405 died... 07:13:17.436828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21405): Terminated: ok {rc=0} 07:13:17.526321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:13:18.678481 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:18.690699 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:13:18.753629 tst iperf3m4.py: using LAC 39270 07:13:18.884007 tst iperf3m4.py: using RAC 255 07:13:19.011834 tst iperf3m4.py: using CellId 39270 07:13:19.137169 tst iperf3m4.py: using BVCI 39271 07:13:19.249470 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:19.260404 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:19.271241 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:19.282146 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:19.292624 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:19.303263 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:19.314205 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:19.324678 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:19.335432 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:13:19.452621 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:13:19.576461 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:13:19.695351 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:13:19.818053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:13:20.042005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:13:20.374968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21407): Launched 07:13:20.663770 run iperf3-srv_10.42.42.10(pid=21408): Launched 07:13:20.787893 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:13:21.011467 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:13:21.343793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21409): Launched 07:13:21.631709 run iperf3-srv_10.42.42.10(pid=21410): Launched 07:13:21.757309 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:13:21.980570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:13:22.313226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21411): Launched 07:13:22.601797 run iperf3-srv_10.42.42.10(pid=21412): Launched 07:13:22.726663 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:13:22.951210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:13:23.286212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21413): Launched 07:13:23.574957 run iperf3-srv_10.42.42.10(pid=21414): Launched 07:13:23.700202 tst iperf3m4.py:8: start network... 07:13:23.923994 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:24.436707 run create_hlr_db(pid=21415): Launched 07:13:24.564869 bus /gobi_6: Setting Powered False 07:13:25.629535 run create_hlr_db(pid=21415): Terminated: ok {rc=0} 07:13:26.090591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21417): Launched 07:13:26.422631 run osmo-hlr_10.42.42.2(pid=21418): Launched 07:13:26.550372 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:27.118792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21420): Launched 07:13:27.451743 run osmo-stp_10.42.42.5(pid=21421): Launched 07:13:27.577777 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:13:28.148262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21423): Launched 07:13:28.276325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:13:28.555644 run patchelf(pid=21424): Launched 07:13:28.740865 run osmo-stp_10.42.42.5(pid=21421): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21421)] 07:13:28.880301 run osmo-stp_10.42.42.5(pid=21421): stdout: | (launched: 2022-12-14_07:13:27.390291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:29.022282 run osmo-stp_10.42.42.5(pid=21421): stderr: | 20221214071327582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071327582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071327583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071327583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071327583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071327584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071327584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:29.164273 run osmo-stp_10.42.42.5(pid=21421): stdout: | (launched: 2022-12-14_07:13:27.390291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:29.299500 run osmo-stp_10.42.42.5(pid=21421): stderr: | 20221214071327582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071327582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071327583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071327583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071327583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071327584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071327584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:29.459823 run patchelf(pid=21424): Terminating (SIGINT) 07:13:29.645857 run patchelf(pid=21424): Terminated: ok {rc=0} 07:13:29.780365 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21421): Process ended prematurely: osmo-stp_10.42.42.5(pid=21421) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21421)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:13:29.790564 tst iperf3m4.py:8: Test FAILED (11.2 sec) 07:13:29.819356 run osmo-hlr_10.42.42.2(pid=21418): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21418)] 07:13:29.870615 run osmo-hlr_10.42.42.2(pid=21418): stdout: | (launched: 2022-12-14_07:13:26.361792) 07:13:29.923264 run osmo-hlr_10.42.42.2(pid=21418): stderr: | 20221214071326556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071326556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071326556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071326556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071326556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071326556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071326569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071326579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071326579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071326579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:29.975753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21407): Terminating (SIGTERM) 07:13:30.018215 run iperf3-srv_10.42.42.10(pid=21408): Terminating (SIGTERM) 07:13:30.060551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21409): Terminating (SIGTERM) 07:13:30.103220 run iperf3-srv_10.42.42.10(pid=21410): Terminating (SIGTERM) 07:13:30.145612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21411): Terminating (SIGTERM) 07:13:30.188112 run iperf3-srv_10.42.42.10(pid=21412): Terminating (SIGTERM) 07:13:30.230304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21413): Terminating (SIGTERM) 07:13:30.272659 run iperf3-srv_10.42.42.10(pid=21414): Terminating (SIGTERM) 07:13:30.314893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21417): Terminating (SIGTERM) 07:13:30.357163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21420): Terminating (SIGTERM) 07:13:30.399330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21423): Terminating (SIGTERM) 07:13:30.441793 --- ParallelTerminationStrategy: PID 21407 died... 07:13:30.462188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21407): Terminated: ok {rc=0} 07:13:30.508756 --- ParallelTerminationStrategy: PID 21408 died... 07:13:30.528559 run iperf3-srv_10.42.42.10(pid=21408): Terminated {rc=256} 07:13:30.574937 --- ParallelTerminationStrategy: PID 21409 died... 07:13:30.594911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21409): Terminated: ok {rc=0} 07:13:30.641293 --- ParallelTerminationStrategy: PID 21410 died... 07:13:30.661079 run iperf3-srv_10.42.42.10(pid=21410): Terminated {rc=256} 07:13:30.707378 --- ParallelTerminationStrategy: PID 21411 died... 07:13:30.727224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21411): Terminated: ok {rc=0} 07:13:30.773483 --- ParallelTerminationStrategy: PID 21412 died... 07:13:30.793205 run iperf3-srv_10.42.42.10(pid=21412): Terminated {rc=256} 07:13:30.839842 --- ParallelTerminationStrategy: PID 21413 died... 07:13:30.871756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21413): Terminated: ok {rc=0} 07:13:30.919533 --- ParallelTerminationStrategy: PID 21414 died... 07:13:30.940399 run iperf3-srv_10.42.42.10(pid=21414): Terminated {rc=256} 07:13:30.987606 --- ParallelTerminationStrategy: PID 21417 died... 07:13:31.008370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21417): Terminated: ok {rc=0} 07:13:31.055748 --- ParallelTerminationStrategy: PID 21420 died... 07:13:31.076331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21420): Terminated: ok {rc=0} 07:13:31.123538 --- ParallelTerminationStrategy: PID 21423 died... 07:13:31.144197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21423): Terminated: ok {rc=0} 07:13:31.233881 bus /gobi_4: Setting Powered False 07:13:32.333819 bus /gobi_4: Setting Powered False 07:13:33.451234 bus /gobi_1: Setting Powered False 07:13:34.550658 bus /gobi_1: Setting Powered False 07:13:35.667634 bus /gobi_0: Setting Powered False 07:13:36.764135 bus /gobi_0: Setting Powered False 07:13:37.882775 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:13:38.986195 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:38.998303 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:13:39.055276 tst ping.py: using LAC 39271 07:13:39.186972 tst ping.py: using RAC 1 07:13:39.313586 tst ping.py: using CellId 39271 07:13:39.430874 tst ping.py: using BVCI 39272 07:13:39.542177 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:39.553340 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:39.564218 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:39.574939 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:39.585787 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:39.596377 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:39.607162 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:39.617811 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:13:39.739968 tst ping.py:19: start network... 07:13:39.943027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:40.412510 run create_hlr_db(pid=21426): Launched 07:13:40.536267 bus /gobi_6: Setting Powered False 07:13:41.596763 run create_hlr_db(pid=21426): Terminated: ok {rc=0} 07:13:42.041721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21428): Launched 07:13:42.366422 run osmo-hlr_10.42.42.2(pid=21429): Launched 07:13:42.491359 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:43.057788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21431): Launched 07:13:43.382933 run osmo-stp_10.42.42.5(pid=21432): Launched 07:13:43.506721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:13:44.066800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21434): Launched 07:13:44.191517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:13:44.466002 run patchelf(pid=21435): Launched 07:13:44.647300 run osmo-stp_10.42.42.5(pid=21432): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21432)] 07:13:44.784838 run osmo-stp_10.42.42.5(pid=21432): stdout: | (launched: 2022-12-14_07:13:43.323410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:44.924287 run osmo-stp_10.42.42.5(pid=21432): stderr: | 20221214071343511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071343511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071343511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071343512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071343512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071343512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071343512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:45.063759 run osmo-stp_10.42.42.5(pid=21432): stdout: | (launched: 2022-12-14_07:13:43.323410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:45.196296 run osmo-stp_10.42.42.5(pid=21432): stderr: | 20221214071343511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071343511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071343511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071343512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071343512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071343512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071343512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:45.353718 run patchelf(pid=21435): Terminating (SIGINT) 07:13:45.536730 run patchelf(pid=21435): Terminated: ok {rc=0} 07:13:45.668677 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21432): Process ended prematurely: osmo-stp_10.42.42.5(pid=21432) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21432)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 07:13:45.678502 tst ping.py:22: Test FAILED (6.7 sec) 07:13:45.706468 run osmo-hlr_10.42.42.2(pid=21429): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21429)] 07:13:45.757442 run osmo-hlr_10.42.42.2(pid=21429): stdout: | (launched: 2022-12-14_07:13:42.306852) 07:13:45.810325 run osmo-hlr_10.42.42.2(pid=21429): stderr: | 20221214071342500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071342500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071342500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071342500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071342500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071342500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071342513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071342521 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071342522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071342522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:45.877958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21428): Terminating (SIGTERM) 07:13:45.932009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21431): Terminating (SIGTERM) 07:13:45.975982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21434): Terminating (SIGTERM) 07:13:46.020901 --- ParallelTerminationStrategy: PID 21428 died... 07:13:46.041721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21428): Terminated: ok {rc=0} 07:13:46.091081 --- ParallelTerminationStrategy: PID 21431 died... 07:13:46.111636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21431): Terminated: ok {rc=0} 07:13:46.159355 --- ParallelTerminationStrategy: PID 21434 died... 07:13:46.180187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21434): Terminated: ok {rc=0} 07:13:46.271083 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:13:47.359789 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:47.371598 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:13:47.429437 tst ping_idle_ping.py: using LAC 39272 07:13:47.550546 tst ping_idle_ping.py: using RAC 2 07:13:47.670716 tst ping_idle_ping.py: using CellId 39272 07:13:47.789748 tst ping_idle_ping.py: using BVCI 39273 07:13:47.899535 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:47.910804 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:47.921814 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:47.932732 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:47.943498 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:47.954501 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:47.965653 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:13:47.976529 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:13:48.092783 tst ping_idle_ping.py:24: start network... 07:13:48.296284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:48.768071 run create_hlr_db(pid=21436): Launched 07:13:48.893298 bus /gobi_6: Setting Powered False 07:13:49.953916 run create_hlr_db(pid=21436): Terminated: ok {rc=0} 07:13:50.400909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21438): Launched 07:13:50.726904 run osmo-hlr_10.42.42.2(pid=21439): Launched 07:13:50.850236 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:51.410256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21441): Launched 07:13:51.736363 run osmo-stp_10.42.42.5(pid=21442): Launched 07:13:51.860081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:13:52.421435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21444): Launched 07:13:52.548627 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:13:52.825417 run patchelf(pid=21445): Launched 07:13:53.008652 run osmo-stp_10.42.42.5(pid=21442): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21442)] 07:13:53.146926 run osmo-stp_10.42.42.5(pid=21442): stdout: | (launched: 2022-12-14_07:13:51.676404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:53.287485 run osmo-stp_10.42.42.5(pid=21442): stderr: | 20221214071351864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071351864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071351865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071351865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071351866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071351866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071351866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:53.427803 run osmo-stp_10.42.42.5(pid=21442): stdout: | (launched: 2022-12-14_07:13:51.676404) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:53.561217 run osmo-stp_10.42.42.5(pid=21442): stderr: | 20221214071351864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071351864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071351865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071351865 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071351866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071351866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071351866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:53.719400 run patchelf(pid=21445): Terminating (SIGINT) 07:13:53.903604 run patchelf(pid=21445): Terminated: ok {rc=0} 07:13:54.036555 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21442): Process ended prematurely: osmo-stp_10.42.42.5(pid=21442) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21442)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:13:54.046248 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:13:54.074213 run osmo-hlr_10.42.42.2(pid=21439): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21439)] 07:13:54.125327 run osmo-hlr_10.42.42.2(pid=21439): stdout: | (launched: 2022-12-14_07:13:50.667166) 07:13:54.177514 run osmo-hlr_10.42.42.2(pid=21439): stderr: | 20221214071350861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071350861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071350861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071350861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071350861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071350861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071350874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071350882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071350883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071350883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:54.230117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21438): Terminating (SIGTERM) 07:13:54.271925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21441): Terminating (SIGTERM) 07:13:54.314633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21444): Terminating (SIGTERM) 07:13:54.357151 --- ParallelTerminationStrategy: PID 21438 died... 07:13:54.377459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21438): Terminated: ok {rc=0} 07:13:54.423931 --- ParallelTerminationStrategy: PID 21441 died... 07:13:54.443884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21441): Terminated: ok {rc=0} 07:13:54.490257 --- ParallelTerminationStrategy: PID 21444 died... 07:13:54.510167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21444): Terminated: ok {rc=0} 07:13:54.598820 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:13:55.899268 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:13:55.906130 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:13:55.927153 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:13:55.967472 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:13:56.058534 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:13:56.080789 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:13:56.120032 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:13:56.712000 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:13:56.766414 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:13:56.777826 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:13:56.836074 tst cs_paging_gprs_active.py: using LAC 39273 07:13:56.966840 tst cs_paging_gprs_active.py: using RAC 3 07:13:57.097925 tst cs_paging_gprs_active.py: using CellId 39273 07:13:57.228460 tst cs_paging_gprs_active.py: using BVCI 39274 07:13:57.350917 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:13:57.362370 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:13:57.373507 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:13:57.384559 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:13:57.396317 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:13:57.407741 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:13:57.419278 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:13:57.430669 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:13:57.442224 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:13:57.561832 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:13:57.680696 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:13:57.888154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:13:58.198697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21450): Launched 07:13:58.467675 run iperf3-srv_10.42.42.10(pid=21451): Launched 07:13:58.583306 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:13:58.789318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:13:59.099255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21452): Launched 07:13:59.368528 run iperf3-srv_10.42.42.10(pid=21453): Launched 07:13:59.483507 tst cs_paging_gprs_active.py:38: start network... 07:13:59.689818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:00.166718 run create_hlr_db(pid=21454): Launched 07:14:00.296490 bus /gobi_6: Setting Powered False 07:14:01.357638 run create_hlr_db(pid=21454): Terminated: ok {rc=0} 07:14:01.801801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21456): Launched 07:14:02.124404 run osmo-hlr_10.42.42.2(pid=21457): Launched 07:14:02.318643 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:02.886670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21459): Launched 07:14:03.219278 run osmo-stp_10.42.42.5(pid=21460): Launched 07:14:03.344772 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:14:03.913572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21462): Launched 07:14:04.043223 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:14:04.324877 run patchelf(pid=21463): Launched 07:14:04.511144 run osmo-stp_10.42.42.5(pid=21460): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21460)] 07:14:04.651798 run osmo-stp_10.42.42.5(pid=21460): stdout: | (launched: 2022-12-14_07:14:03.158212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:04.793173 run osmo-stp_10.42.42.5(pid=21460): stderr: | 20221214071403348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071403348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071403348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071403349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071403349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071403349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071403349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:04.935070 run osmo-stp_10.42.42.5(pid=21460): stdout: | (launched: 2022-12-14_07:14:03.158212) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:05.070537 run osmo-stp_10.42.42.5(pid=21460): stderr: | 20221214071403348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071403348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071403348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071403349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071403349 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071403349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071403349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:05.231090 run patchelf(pid=21463): Terminating (SIGINT) 07:14:05.418232 run patchelf(pid=21463): Terminated: ok {rc=0} 07:14:05.553104 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21460): Process ended prematurely: osmo-stp_10.42.42.5(pid=21460) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21460)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:14:05.563391 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:14:05.591767 run osmo-hlr_10.42.42.2(pid=21457): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21457)] 07:14:05.642942 run osmo-hlr_10.42.42.2(pid=21457): stdout: | (launched: 2022-12-14_07:14:02.066643) 07:14:05.695233 run osmo-hlr_10.42.42.2(pid=21457): stderr: | 20221214071402269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071402269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071402269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071402269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071402269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071402269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071402281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071402289 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071402289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071402289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:05.747796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21450): Terminating (SIGTERM) 07:14:05.789907 run iperf3-srv_10.42.42.10(pid=21451): Terminating (SIGTERM) 07:14:05.832176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21452): Terminating (SIGTERM) 07:14:05.874593 run iperf3-srv_10.42.42.10(pid=21453): Terminating (SIGTERM) 07:14:05.917270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21456): Terminating (SIGTERM) 07:14:05.959825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21459): Terminating (SIGTERM) 07:14:06.002456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21462): Terminating (SIGTERM) 07:14:06.045089 --- ParallelTerminationStrategy: PID 21450 died... 07:14:06.065595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21450): Terminated: ok {rc=0} 07:14:06.112259 --- ParallelTerminationStrategy: PID 21451 died... 07:14:06.132131 run iperf3-srv_10.42.42.10(pid=21451): Terminated {rc=256} 07:14:06.178604 --- ParallelTerminationStrategy: PID 21452 died... 07:14:06.198587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21452): Terminated: ok {rc=0} 07:14:06.244733 --- ParallelTerminationStrategy: PID 21453 died... 07:14:06.264678 run iperf3-srv_10.42.42.10(pid=21453): Terminated {rc=256} 07:14:06.310916 --- ParallelTerminationStrategy: PID 21456 died... 07:14:06.330878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21456): Terminated: ok {rc=0} 07:14:06.377459 --- ParallelTerminationStrategy: PID 21459 died... 07:14:06.397318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21459): Terminated: ok {rc=0} 07:14:06.443781 --- ParallelTerminationStrategy: PID 21462 died... 07:14:06.463769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21462): Terminated: ok {rc=0} 07:14:06.552427 bus /gobi_0: Setting Powered False 07:14:07.651291 bus /gobi_0: Setting Powered False 07:14:08.767201 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:14:09.918286 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:09.930691 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:14:09.992287 tst iperf3.py: using LAC 39274 07:14:10.122720 tst iperf3.py: using RAC 4 07:14:10.252901 tst iperf3.py: using CellId 39274 07:14:10.381735 tst iperf3.py: using BVCI 39275 07:14:10.503580 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:10.515161 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:10.526324 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:10.537553 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:10.548897 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:10.560373 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:10.571973 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:10.583574 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:10.595295 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:14:10.713177 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:14:10.919750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:14:11.229405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21464): Launched 07:14:11.499445 run iperf3-srv_10.42.42.10(pid=21465): Launched 07:14:11.614451 tst iperf3.py:8: start network... 07:14:11.819935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:12.300755 run create_hlr_db(pid=21466): Launched 07:14:12.427680 bus /gobi_6: Setting Powered False 07:14:13.488161 run create_hlr_db(pid=21466): Terminated: ok {rc=0} 07:14:13.940075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21468): Launched 07:14:14.273417 run osmo-hlr_10.42.42.2(pid=21469): Launched 07:14:14.399269 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:14.972606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21471): Launched 07:14:15.304325 run osmo-stp_10.42.42.5(pid=21472): Launched 07:14:15.430355 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:14:16.022467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21474): Launched 07:14:16.154020 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:14:16.424573 run patchelf(pid=21475): Launched 07:14:16.615087 run osmo-stp_10.42.42.5(pid=21472): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21472)] 07:14:16.748292 run osmo-stp_10.42.42.5(pid=21472): stdout: | (launched: 2022-12-14_07:14:15.243214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:16.884224 run osmo-stp_10.42.42.5(pid=21472): stderr: | 20221214071415434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071415434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071415435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071415435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071415436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071415436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071415436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:17.021989 run osmo-stp_10.42.42.5(pid=21472): stdout: | (launched: 2022-12-14_07:14:15.243214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:17.150358 run osmo-stp_10.42.42.5(pid=21472): stderr: | 20221214071415434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071415434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071415435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071415435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071415436 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071415436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071415436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:17.301662 run patchelf(pid=21475): Terminating (SIGINT) 07:14:17.476767 run patchelf(pid=21475): Terminated: ok {rc=0} 07:14:17.603434 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21472): Process ended prematurely: osmo-stp_10.42.42.5(pid=21472) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21472)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 07:14:17.613156 tst iperf3.py:8: Test FAILED (7.7 sec) 07:14:17.640218 run osmo-hlr_10.42.42.2(pid=21469): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21469)] 07:14:17.688223 run osmo-hlr_10.42.42.2(pid=21469): stdout: | (launched: 2022-12-14_07:14:14.212796) 07:14:17.738194 run osmo-hlr_10.42.42.2(pid=21469): stderr: | 20221214071414410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071414410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071414410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071414410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071414410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071414410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071414422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071414431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071414431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071414431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:17.788735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21464): Terminating (SIGTERM) 07:14:17.829569 run iperf3-srv_10.42.42.10(pid=21465): Terminating (SIGTERM) 07:14:17.870392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21468): Terminating (SIGTERM) 07:14:17.910933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21471): Terminating (SIGTERM) 07:14:17.951816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21474): Terminating (SIGTERM) 07:14:17.992619 --- ParallelTerminationStrategy: PID 21464 died... 07:14:18.012084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21464): Terminated: ok {rc=0} 07:14:18.056698 --- ParallelTerminationStrategy: PID 21465 died... 07:14:18.075896 run iperf3-srv_10.42.42.10(pid=21465): Terminated {rc=256} 07:14:18.120032 --- ParallelTerminationStrategy: PID 21468 died... 07:14:18.138951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21468): Terminated: ok {rc=0} 07:14:18.183258 --- ParallelTerminationStrategy: PID 21471 died... 07:14:18.202161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21471): Terminated: ok {rc=0} 07:14:18.246399 --- ParallelTerminationStrategy: PID 21474 died... 07:14:18.265334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21474): Terminated: ok {rc=0} 07:14:18.351970 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:14:19.500801 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:19.512532 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:14:19.570980 tst iperf3m4.py: using LAC 39275 07:14:19.691742 tst iperf3m4.py: using RAC 5 07:14:19.814320 tst iperf3m4.py: using CellId 39275 07:14:19.936444 tst iperf3m4.py: using BVCI 39276 07:14:20.050193 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:20.061315 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:20.071968 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:20.082721 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:20.093295 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:20.103951 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:20.114982 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:20.125593 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:20.136335 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:14:20.258635 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:14:20.381104 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:14:20.499362 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:14:20.622512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:14:20.829926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:14:21.140829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21476): Launched 07:14:21.410727 run iperf3-srv_10.42.42.10(pid=21477): Launched 07:14:21.527718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:14:21.733678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:14:22.042736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21478): Launched 07:14:22.314130 run iperf3-srv_10.42.42.10(pid=21479): Launched 07:14:22.429432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:14:22.635689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:14:22.945222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21480): Launched 07:14:23.214167 run iperf3-srv_10.42.42.10(pid=21481): Launched 07:14:23.329307 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:14:23.534486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:14:23.843867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21482): Launched 07:14:24.113123 run iperf3-srv_10.42.42.10(pid=21483): Launched 07:14:24.227867 tst iperf3m4.py:8: start network... 07:14:24.432805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:24.909968 run create_hlr_db(pid=21484): Launched 07:14:25.035738 bus /gobi_6: Setting Powered False 07:14:26.096204 run create_hlr_db(pid=21484): Terminated: ok {rc=0} 07:14:26.546324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21486): Launched 07:14:26.879003 run osmo-hlr_10.42.42.2(pid=21487): Launched 07:14:27.006665 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:27.582788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21489): Launched 07:14:27.896684 run osmo-stp_10.42.42.5(pid=21490): Launched 07:14:28.013222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:14:28.542233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21492): Launched 07:14:28.662084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:14:28.921996 run patchelf(pid=21493): Launched 07:14:29.094736 run osmo-stp_10.42.42.5(pid=21490): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21490)] 07:14:29.224225 run osmo-stp_10.42.42.5(pid=21490): stdout: | (launched: 2022-12-14_07:14:27.839470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:29.355621 run osmo-stp_10.42.42.5(pid=21490): stderr: | 20221214071428010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071428010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071428010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071428011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071428011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071428011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071428012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:29.487122 run osmo-stp_10.42.42.5(pid=21490): stdout: | (launched: 2022-12-14_07:14:27.839470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:29.612248 run osmo-stp_10.42.42.5(pid=21490): stderr: | 20221214071428010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071428010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071428010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071428011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071428011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071428011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071428012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:29.760629 run patchelf(pid=21493): Terminating (SIGINT) 07:14:29.934968 run patchelf(pid=21493): Terminated: ok {rc=0} 07:14:30.060309 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21490): Process ended prematurely: osmo-stp_10.42.42.5(pid=21490) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21490)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:14:30.069895 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:14:30.097292 run osmo-hlr_10.42.42.2(pid=21487): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21487)] 07:14:30.144919 run osmo-hlr_10.42.42.2(pid=21487): stdout: | (launched: 2022-12-14_07:14:26.818478) 07:14:30.194325 run osmo-hlr_10.42.42.2(pid=21487): stderr: | 20221214071427014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071427014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071427014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071427014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071427014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071427014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071427026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071427035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071427035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071427035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:30.244263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21476): Terminating (SIGTERM) 07:14:30.284350 run iperf3-srv_10.42.42.10(pid=21477): Terminating (SIGTERM) 07:14:30.324343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21478): Terminating (SIGTERM) 07:14:30.364104 run iperf3-srv_10.42.42.10(pid=21479): Terminating (SIGTERM) 07:14:30.403796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21480): Terminating (SIGTERM) 07:14:30.443770 run iperf3-srv_10.42.42.10(pid=21481): Terminating (SIGTERM) 07:14:30.483609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21482): Terminating (SIGTERM) 07:14:30.523413 run iperf3-srv_10.42.42.10(pid=21483): Terminating (SIGTERM) 07:14:30.563162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21486): Terminating (SIGTERM) 07:14:30.603712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21489): Terminating (SIGTERM) 07:14:30.643562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21492): Terminating (SIGTERM) 07:14:30.683670 --- ParallelTerminationStrategy: PID 21476 died... 07:14:30.703030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21476): Terminated: ok {rc=0} 07:14:30.747235 --- ParallelTerminationStrategy: PID 21477 died... 07:14:30.765924 run iperf3-srv_10.42.42.10(pid=21477): Terminated {rc=256} 07:14:30.809782 --- ParallelTerminationStrategy: PID 21478 died... 07:14:30.828599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21478): Terminated: ok {rc=0} 07:14:30.873840 --- ParallelTerminationStrategy: PID 21479 died... 07:14:30.893183 run iperf3-srv_10.42.42.10(pid=21479): Terminated {rc=256} 07:14:30.937931 --- ParallelTerminationStrategy: PID 21480 died... 07:14:30.957227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21480): Terminated: ok {rc=0} 07:14:31.002295 --- ParallelTerminationStrategy: PID 21481 died... 07:14:31.021574 run iperf3-srv_10.42.42.10(pid=21481): Terminated {rc=256} 07:14:31.066566 --- ParallelTerminationStrategy: PID 21482 died... 07:14:31.085941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21482): Terminated: ok {rc=0} 07:14:31.131056 --- ParallelTerminationStrategy: PID 21483 died... 07:14:31.150317 run iperf3-srv_10.42.42.10(pid=21483): Terminated {rc=256} 07:14:31.195294 --- ParallelTerminationStrategy: PID 21486 died... 07:14:31.214730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21486): Terminated: ok {rc=0} 07:14:31.259753 --- ParallelTerminationStrategy: PID 21489 died... 07:14:31.279300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21489): Terminated: ok {rc=0} 07:14:31.324113 --- ParallelTerminationStrategy: PID 21492 died... 07:14:31.343291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21492): Terminated: ok {rc=0} 07:14:31.432734 bus /gobi_4: Setting Powered False 07:14:32.546798 bus /gobi_4: Setting Powered False 07:14:33.666761 bus /gobi_1: Setting Powered False 07:14:34.765302 bus /gobi_1: Setting Powered False 07:14:35.881913 bus /gobi_0: Setting Powered False 07:14:36.982084 bus /gobi_0: Setting Powered False 07:14:38.100432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:14:39.203548 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:39.215913 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:14:39.276076 tst ping.py: using LAC 39276 07:14:39.407731 tst ping.py: using RAC 6 07:14:39.534881 tst ping.py: using CellId 39276 07:14:39.660513 tst ping.py: using BVCI 39277 07:14:39.778945 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:39.790464 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:39.801706 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:39.812743 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:39.824266 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:39.835717 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:39.847344 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:39.858907 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:14:39.975917 tst ping.py:19: start network... 07:14:40.179898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:40.648288 run create_hlr_db(pid=21494): Launched 07:14:40.773632 bus /gobi_6: Setting Powered False 07:14:41.833925 run create_hlr_db(pid=21494): Terminated: ok {rc=0} 07:14:42.278318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21496): Launched 07:14:42.603972 run osmo-hlr_10.42.42.2(pid=21497): Launched 07:14:42.728804 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:43.297682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21499): Launched 07:14:43.626259 run osmo-stp_10.42.42.5(pid=21500): Launched 07:14:43.749704 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:14:44.309892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21502): Launched 07:14:44.433959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:14:44.708804 run patchelf(pid=21503): Launched 07:14:44.890566 run osmo-stp_10.42.42.5(pid=21500): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21500)] 07:14:45.029106 run osmo-stp_10.42.42.5(pid=21500): stdout: | (launched: 2022-12-14_07:14:43.565629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:45.168672 run osmo-stp_10.42.42.5(pid=21500): stderr: | 20221214071443753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071443754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071443754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071443754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071443755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071443755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071443755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:45.308425 run osmo-stp_10.42.42.5(pid=21500): stdout: | (launched: 2022-12-14_07:14:43.565629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:45.441467 run osmo-stp_10.42.42.5(pid=21500): stderr: | 20221214071443753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071443754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071443754 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071443754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071443755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071443755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071443755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:45.599133 run patchelf(pid=21503): Terminating (SIGINT) 07:14:45.782106 run patchelf(pid=21503): Terminated: ok {rc=0} 07:14:45.938955 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21500): Process ended prematurely: osmo-stp_10.42.42.5(pid=21500) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21500)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 07:14:45.949841 tst ping.py:22: Test FAILED (6.7 sec) 07:14:45.979424 run osmo-hlr_10.42.42.2(pid=21497): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21497)] 07:14:46.035868 run osmo-hlr_10.42.42.2(pid=21497): stdout: | (launched: 2022-12-14_07:14:42.543705) 07:14:46.088325 run osmo-hlr_10.42.42.2(pid=21497): stderr: | 20221214071442739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071442739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071442739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071442739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071442739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071442739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071442761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071442770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071442771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071442771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:46.141797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21496): Terminating (SIGTERM) 07:14:46.185678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21499): Terminating (SIGTERM) 07:14:46.230394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21502): Terminating (SIGTERM) 07:14:46.275493 --- ParallelTerminationStrategy: PID 21496 died... 07:14:46.296545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21496): Terminated: ok {rc=0} 07:14:46.345553 --- ParallelTerminationStrategy: PID 21499 died... 07:14:46.366749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21499): Terminated: ok {rc=0} 07:14:46.413480 --- ParallelTerminationStrategy: PID 21502 died... 07:14:46.433846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21502): Terminated: ok {rc=0} 07:14:46.523676 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:14:47.610473 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:47.622141 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:14:47.679897 tst ping_idle_ping.py: using LAC 39277 07:14:47.800786 tst ping_idle_ping.py: using RAC 7 07:14:47.930393 tst ping_idle_ping.py: using CellId 39277 07:14:48.063279 tst ping_idle_ping.py: using BVCI 39278 07:14:48.183960 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:48.195782 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:48.207226 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:48.218732 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:48.230405 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:48.242228 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:48.254172 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:14:48.265931 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:14:48.387475 tst ping_idle_ping.py:24: start network... 07:14:48.607925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:49.120875 run create_hlr_db(pid=21504): Launched 07:14:49.244406 bus /gobi_6: Setting Powered False 07:14:50.308527 run create_hlr_db(pid=21504): Terminated: ok {rc=0} 07:14:50.763238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21506): Launched 07:14:51.092624 run osmo-hlr_10.42.42.2(pid=21507): Launched 07:14:51.216908 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:51.781033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21509): Launched 07:14:52.107363 run osmo-stp_10.42.42.5(pid=21510): Launched 07:14:52.232335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:14:52.792792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21512): Launched 07:14:52.917787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:14:53.194687 run patchelf(pid=21513): Launched 07:14:53.375535 run osmo-stp_10.42.42.5(pid=21510): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21510)] 07:14:53.514072 run osmo-stp_10.42.42.5(pid=21510): stdout: | (launched: 2022-12-14_07:14:52.047637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:53.654226 run osmo-stp_10.42.42.5(pid=21510): stderr: | 20221214071452236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071452236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071452236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071452237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071452237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071452237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071452237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:53.794597 run osmo-stp_10.42.42.5(pid=21510): stdout: | (launched: 2022-12-14_07:14:52.047637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:53.928121 run osmo-stp_10.42.42.5(pid=21510): stderr: | 20221214071452236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071452236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071452236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071452237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071452237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071452237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071452237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:54.086476 run patchelf(pid=21513): Terminating (SIGINT) 07:14:54.270350 run patchelf(pid=21513): Terminated: ok {rc=0} 07:14:54.402950 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21510): Process ended prematurely: osmo-stp_10.42.42.5(pid=21510) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21510)] [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:14:54.412506 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:14:54.440579 run osmo-hlr_10.42.42.2(pid=21507): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21507)] 07:14:54.491752 run osmo-hlr_10.42.42.2(pid=21507): stdout: | (launched: 2022-12-14_07:14:51.032351) 07:14:54.545178 run osmo-hlr_10.42.42.2(pid=21507): stderr: | 20221214071451227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071451228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071451228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071451228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071451228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071451228 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071451241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071451249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071451249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071451249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:54.598456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21506): Terminating (SIGTERM) 07:14:54.640834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21509): Terminating (SIGTERM) 07:14:54.683617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21512): Terminating (SIGTERM) 07:14:54.726449 --- ParallelTerminationStrategy: PID 21506 died... 07:14:54.747103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21506): Terminated: ok {rc=0} 07:14:54.793843 --- ParallelTerminationStrategy: PID 21509 died... 07:14:54.814003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21509): Terminated: ok {rc=0} 07:14:54.860577 --- ParallelTerminationStrategy: PID 21512 died... 07:14:54.880621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21512): Terminated: ok {rc=0} 07:14:54.968585 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:14:56.258585 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:14:56.265103 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:14:56.285497 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:14:56.319663 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:14:56.373018 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:14:56.393458 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:14:56.427337 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:14:56.989848 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:14:56.995123 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:14:57.006723 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:14:57.064802 tst switch_tch_pdch.py: using LAC 39278 07:14:57.192773 tst switch_tch_pdch.py: using RAC 8 07:14:57.313323 tst switch_tch_pdch.py: using CellId 39278 07:14:57.442717 tst switch_tch_pdch.py: using BVCI 39279 07:14:57.560806 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:14:57.572599 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:14:57.584110 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:14:57.595511 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:14:57.607231 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:14:57.619060 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:14:57.630940 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:14:57.642726 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:14:57.760495 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:14:57.884412 tst switch_tch_pdch.py:51: start network... 07:14:58.103785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:58.605594 run create_hlr_db(pid=21518): Launched 07:14:58.731073 bus /gobi_6: Setting Powered False 07:14:59.794695 run create_hlr_db(pid=21518): Terminated: ok {rc=0} 07:15:00.229848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21520): Launched 07:15:00.532459 run osmo-hlr_10.42.42.2(pid=21521): Launched 07:15:00.647243 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:01.233079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21526): Launched 07:15:01.555666 run osmo-stp_10.42.42.5(pid=21527): Launched 07:15:01.794689 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:15:02.450032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21529): Launched 07:15:02.565160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:15:02.820166 run patchelf(pid=21530): Launched 07:15:02.988846 run osmo-stp_10.42.42.5(pid=21527): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21527)] 07:15:03.116645 run osmo-stp_10.42.42.5(pid=21527): stdout: | (launched: 2022-12-14_07:15:01.495580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:03.246033 run osmo-stp_10.42.42.5(pid=21527): stderr: | 20221214071501816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071501817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071501817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071501817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071501818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071501818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071501818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:03.375398 run osmo-stp_10.42.42.5(pid=21527): stdout: | (launched: 2022-12-14_07:15:01.495580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:03.497848 run osmo-stp_10.42.42.5(pid=21527): stderr: | 20221214071501816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071501817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071501817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071501817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071501818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071501818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071501818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:03.643475 run patchelf(pid=21530): Terminating (SIGINT) 07:15:03.814078 run patchelf(pid=21530): Terminated: ok {rc=0} 07:15:03.937245 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21527): Process ended prematurely: osmo-stp_10.42.42.5(pid=21527) [trial-2401↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21527)] [trial-2401↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:15:03.946015 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 07:15:03.972401 run osmo-hlr_10.42.42.2(pid=21521): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21521)] 07:15:04.019888 run osmo-hlr_10.42.42.2(pid=21521): stdout: | (launched: 2022-12-14_07:15:00.475566) 07:15:04.069058 run osmo-hlr_10.42.42.2(pid=21521): stderr: | 20221214071500648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071500648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071500648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071500648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071500648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071500648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071500661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071500669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071500669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071500669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:04.118586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21520): Terminating (SIGTERM) 07:15:04.158207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21526): Terminating (SIGTERM) 07:15:04.197929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21529): Terminating (SIGTERM) 07:15:04.237896 --- ParallelTerminationStrategy: PID 21520 died... 07:15:04.257234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21520): Terminated: ok {rc=0} 07:15:04.300884 --- ParallelTerminationStrategy: PID 21526 died... 07:15:04.319787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21526): Terminated: ok {rc=0} 07:15:04.363238 --- ParallelTerminationStrategy: PID 21529 died... 07:15:04.381743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21529): Terminated: ok {rc=0} 07:15:04.467257 bus /gobi_0: Setting Powered False 07:15:05.567390 bus /gobi_0: Setting Powered False 07:15:06.682428 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:15:07.921735 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:07.927714 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:15:07.948021 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:15:07.982566 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:15:08.035797 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:15:08.056938 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:15:08.092429 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:15:08.648052 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:15:08.654015 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:15:08.665477 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:15:08.721921 tst switch_tch_pdch.py: using LAC 39279 07:15:08.846986 tst switch_tch_pdch.py: using RAC 9 07:15:08.973392 tst switch_tch_pdch.py: using CellId 39279 07:15:09.098477 tst switch_tch_pdch.py: using BVCI 39280 07:15:09.218094 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:15:09.229607 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:15:09.240616 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:15:09.251778 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:15:09.263143 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:15:09.274883 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:15:09.287129 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:15:09.298818 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:15:09.416636 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:15:09.538956 tst switch_tch_pdch.py:51: start network... 07:15:09.757867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:10.231865 run create_hlr_db(pid=21534): Launched 07:15:10.354729 bus /gobi_6: Setting Powered False 07:15:11.418209 run create_hlr_db(pid=21534): Terminated: ok {rc=0} 07:15:11.825296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21536): Launched 07:15:12.126478 run osmo-hlr_10.42.42.2(pid=21537): Launched 07:15:12.242398 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:12.734182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21539): Launched 07:15:13.035461 run osmo-stp_10.42.42.5(pid=21540): Launched 07:15:13.148913 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:15:13.642356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21542): Launched 07:15:13.757471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:15:14.012040 run patchelf(pid=21543): Launched 07:15:14.179169 run osmo-stp_10.42.42.5(pid=21540): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21540)] 07:15:14.306801 run osmo-stp_10.42.42.5(pid=21540): stdout: | (launched: 2022-12-14_07:15:12.979819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:14.435501 run osmo-stp_10.42.42.5(pid=21540): stderr: | 20221214071513147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071513147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071513148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071513148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071513148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071513149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071513149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:14.564695 run osmo-stp_10.42.42.5(pid=21540): stdout: | (launched: 2022-12-14_07:15:12.979819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:14.686916 run osmo-stp_10.42.42.5(pid=21540): stderr: | 20221214071513147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071513147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071513148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071513148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071513148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071513149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071513149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:14.832325 run patchelf(pid=21543): Terminating (SIGINT) 07:15:15.003515 run patchelf(pid=21543): Terminated: ok {rc=0} 07:15:15.127321 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=21540): Process ended prematurely: osmo-stp_10.42.42.5(pid=21540) [trial-2401↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21540)] [trial-2401↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:15:15.136275 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 07:15:15.162583 run osmo-hlr_10.42.42.2(pid=21537): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21537)] 07:15:15.209836 run osmo-hlr_10.42.42.2(pid=21537): stdout: | (launched: 2022-12-14_07:15:12.070564) 07:15:15.258878 run osmo-hlr_10.42.42.2(pid=21537): stderr: | 20221214071512242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071512242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071512242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071512242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071512243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071512243 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071512255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071512263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071512263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071512263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:15.308262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21536): Terminating (SIGTERM) 07:15:15.348152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21539): Terminating (SIGTERM) 07:15:15.388105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21542): Terminating (SIGTERM) 07:15:15.427879 --- ParallelTerminationStrategy: PID 21536 died... 07:15:15.446740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21536): Terminated: ok {rc=0} 07:15:15.490134 --- ParallelTerminationStrategy: PID 21539 died... 07:15:15.508478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21539): Terminated: ok {rc=0} 07:15:15.552203 --- ParallelTerminationStrategy: PID 21542 died... 07:15:15.570768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21542): Terminated: ok {rc=0} 07:15:15.656465 bus /gobi_0: Setting Powered False 07:15:16.761655 bus /gobi_0: Setting Powered False 07:15:17.886178 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_sms:trx-b200 --------------------------------------------------------------------- 07:15:19.120561 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:19.124844 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 07:15:19.158360 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 07:15:19.165655 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 07:15:19.219703 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 07:15:19.253294 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 07:15:19.259955 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 07:15:19.798206 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 07:15:19.803692 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 07:15:19.814754 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 07:15:19.863559 tst mo_mt_sms.py: using LAC 39280 07:15:19.993519 tst mo_mt_sms.py: using RAC 10 07:15:20.113360 tst mo_mt_sms.py: using CellId 39280 07:15:20.232070 tst mo_mt_sms.py: using BVCI 39281 07:15:20.343075 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 07:15:20.463241 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 07:15:20.577539 tst mo_mt_sms.py:9: start nitb and bts... 07:15:20.781131 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:15:21.400284 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21547): Launched 07:15:21.703415 run osmo-nitb_10.42.42.2(pid=21548): Launched 07:15:21.870402 run osmo-nitb_10.42.42.2(pid=21548): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21548)] 07:15:22.006051 run osmo-nitb_10.42.42.2(pid=21548): stdout: | (launched: 2022-12-14_07:15:21.647562) 07:15:22.143214 run osmo-nitb_10.42.42.2(pid=21548): stderr: | (launched: 2022-12-14_07:15:21.692375) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:15:22.280190 run osmo-nitb_10.42.42.2(pid=21548): stdout: | (launched: 2022-12-14_07:15:21.647562) 07:15:22.411319 run osmo-nitb_10.42.42.2(pid=21548): stderr: | (launched: 2022-12-14_07:15:21.692375) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21548): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21548) [trial-2401↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21548)] 07:15:22.817543 tst osmo-nitb_10.42.42.2(pid=21548): stdout: | (launched: 2022-12-14_07:15:21.647562) 07:15:22.939728 tst osmo-nitb_10.42.42.2(pid=21548): stderr: | (launched: 2022-12-14_07:15:21.692375) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:15:23.085136 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=21548): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21548) [trial-2401↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21548)] [trial-2401↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 07:15:23.093738 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 07:15:23.100479 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21547): Terminating (SIGTERM) 07:15:23.309298 --- ParallelTerminationStrategy: PID 21547 died... 07:15:23.329462 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21547): Terminated: ok {rc=0} 07:15:23.415727 bus /sierra_3: Setting Powered False 07:15:24.516333 bus /sierra_3: Setting Powered False 07:15:25.633041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 sms:trx-b200 --------------------------------------------------------------------- 07:15:26.833108 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:26.837635 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 07:15:26.871469 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 07:15:26.900417 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 07:15:26.955047 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 07:15:26.988865 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 07:15:27.016695 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 07:15:27.561715 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 07:15:27.567109 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:27.578386 tst sms:trx-b200: Using 1 x bts (candidates: 1) 07:15:27.633778 tst mo_mt_sms.py: using LAC 39281 07:15:27.761392 tst mo_mt_sms.py: using RAC 11 07:15:27.886949 tst mo_mt_sms.py: using CellId 39281 07:15:28.013143 tst mo_mt_sms.py: using BVCI 39282 07:15:28.130247 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:28.141633 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:28.152649 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:28.163813 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:28.175299 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:28.186728 tst sms:trx-b200: Using 1 x modem (candidates: 2) 07:15:28.304528 tst sms:trx-b200: Using 1 x modem (candidates: 2) 07:15:28.425780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:28.928863 run create_hlr_db(pid=21552): Launched 07:15:29.052809 bus /sierra_2: Setting Powered False 07:15:30.117488 run create_hlr_db(pid=21552): Terminated: ok {rc=0} 07:15:30.571244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21554): Launched 07:15:30.913427 run osmo-hlr_10.42.42.2(pid=21555): Launched 07:15:31.147352 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:31.776186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21557): Launched 07:15:32.121133 run osmo-stp_10.42.42.5(pid=21558): Launched 07:15:32.355180 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:32.951597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21560): Launched 07:15:33.275839 run osmo-msc_10.42.42.6(pid=21561): Launched 07:15:33.456681 run osmo-stp_10.42.42.5(pid=21558): ERR: Terminated: ERROR {rc=1} [trial-2401↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21558)] 07:15:33.592876 run osmo-stp_10.42.42.5(pid=21558): stdout: | (launched: 2022-12-14_07:15:32.062292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:33.729780 run osmo-stp_10.42.42.5(pid=21558): stderr: | 20221214071532291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071532291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071532291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071532292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071532292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071532292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071532292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:33.864761 run osmo-stp_10.42.42.5(pid=21558): stdout: | (launched: 2022-12-14_07:15:32.062292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:33.993779 run osmo-stp_10.42.42.5(pid=21558): stderr: | 20221214071532291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071532291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071532291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071532292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071532292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071532292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071532292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:34.147826 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=21558): Process ended prematurely: osmo-stp_10.42.42.5(pid=21558) [trial-2401↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21558)] [trial-2401↪sms:trx-b200↪mo_mt_sms.py:16] 07:15:34.156889 tst mo_mt_sms.py:16: Test FAILED (6.6 sec) 07:15:34.184260 run osmo-hlr_10.42.42.2(pid=21555): ERR: Terminated: ERROR {rc=237} [trial-2401↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21555)] 07:15:34.235963 run osmo-hlr_10.42.42.2(pid=21555): stdout: | (launched: 2022-12-14_07:15:30.841191) 07:15:34.288712 run osmo-hlr_10.42.42.2(pid=21555): stderr: | 20221214071531033 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071531033 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071531033 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071531033 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071531033 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071531033 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071531047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071531055 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071531055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071531055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:34.362044 run osmo-msc_10.42.42.6(pid=21561): ERR: Terminated: ERROR {rc=2} [trial-2401↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21561)] 07:15:34.412446 run osmo-msc_10.42.42.6(pid=21561): stdout: | (launched: 2022-12-14_07:15:33.216228) 07:15:34.465208 run osmo-msc_10.42.42.6(pid=21561): stderr: | 20221214071533536 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071533536 DLGLOBAL DEBUG validating counter group 0x7f01ffe48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071533536 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071533536 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071533537 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071533537 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071533539 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071533539 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071533539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071533539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:34.518027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21554): Terminating (SIGTERM) 07:15:34.560229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21557): Terminating (SIGTERM) 07:15:34.602815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21560): Terminating (SIGTERM) 07:15:34.645643 --- ParallelTerminationStrategy: PID 21554 died... 07:15:34.666186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21554): Terminated: ok {rc=0} 07:15:34.713019 --- ParallelTerminationStrategy: PID 21557 died... 07:15:34.733084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21557): Terminated: ok {rc=0} 07:15:34.779924 --- ParallelTerminationStrategy: PID 21560 died... 07:15:34.799993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21560): Terminated: ok {rc=0} 07:15:34.889913 bus /sierra_3: Setting Powered False 07:15:35.989756 bus /sierra_3: Setting Powered False 07:15:37.106792 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-b200 --------------------------------------------------------------------- 07:15:38.341920 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:38.346026 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 07:15:38.379768 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 07:15:38.388068 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 07:15:38.424343 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 07:15:38.458693 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 07:15:38.466250 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 07:15:38.985639 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 07:15:38.992653 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 07:15:39.004113 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 07:15:39.051602 tst assert_extension.py: using LAC 39282 07:15:39.172061 tst assert_extension.py: using RAC 12 07:15:39.290696 tst assert_extension.py: using CellId 39282 07:15:39.411051 tst assert_extension.py: using BVCI 39283 07:15:39.522365 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 07:15:39.641981 tst assert_extension.py:10: start nitb and bts... 07:15:39.861970 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:15:40.524724 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21566): Launched 07:15:40.846972 run osmo-nitb_10.42.42.2(pid=21567): Launched 07:15:41.027739 run osmo-nitb_10.42.42.2(pid=21567): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21567)] 07:15:41.172499 run osmo-nitb_10.42.42.2(pid=21567): stdout: | (launched: 2022-12-14_07:15:40.787838) 07:15:41.318697 run osmo-nitb_10.42.42.2(pid=21567): stderr: | (launched: 2022-12-14_07:15:40.835633) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:15:41.465129 run osmo-nitb_10.42.42.2(pid=21567): stdout: | (launched: 2022-12-14_07:15:40.787838) 07:15:41.605126 run osmo-nitb_10.42.42.2(pid=21567): stderr: | (launched: 2022-12-14_07:15:40.835633) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=21567): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21567) [trial-2401↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21567)] 07:15:41.971011 tst osmo-nitb_10.42.42.2(pid=21567): stdout: | (launched: 2022-12-14_07:15:40.787838) 07:15:42.102624 tst osmo-nitb_10.42.42.2(pid=21567): stderr: | (launched: 2022-12-14_07:15:40.835633) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:15:42.257323 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=21567): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21567) [trial-2401↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21567)] [trial-2401↪nitb_ussd:trx-b200↪assert_extension.py:12] 07:15:42.266406 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:15:42.273489 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21566): Terminating (SIGTERM) 07:15:42.484916 --- ParallelTerminationStrategy: PID 21566 died... 07:15:42.506478 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=21566): Terminated: ok {rc=0} 07:15:42.594925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 ussd:trx-b200 --------------------------------------------------------------------- 07:15:43.772416 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:43.776856 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 07:15:43.810600 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 07:15:43.838904 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 07:15:43.875284 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 07:15:43.909402 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 07:15:43.936820 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 07:15:44.465746 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 ussd:trx-b200 assert_extension.py ---------------------------------------------- 07:15:44.471115 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:44.482626 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 07:15:44.538860 tst assert_extension.py: using LAC 39283 07:15:44.658250 tst assert_extension.py: using RAC 13 07:15:44.776313 tst assert_extension.py: using CellId 39283 07:15:44.893562 tst assert_extension.py: using BVCI 39284 07:15:45.002546 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:45.013372 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:45.024064 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:45.034625 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:45.045120 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:15:45.055565 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 07:15:45.169953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:45.637979 run create_hlr_db(pid=21572): Launched 07:15:45.763099 bus /sierra_2: Setting Powered False 07:15:46.825855 run create_hlr_db(pid=21572): Terminated: ok {rc=0} 07:15:47.296328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21574): Launched 07:15:47.621665 run osmo-hlr_10.42.42.2(pid=21575): Launched 07:15:47.745823 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:48.313443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21577): Launched 07:15:48.640077 run osmo-stp_10.42.42.5(pid=21578): Launched 07:15:48.762683 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:49.346998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21580): Launched 07:15:49.670632 run osmo-msc_10.42.42.6(pid=21581): Launched 07:15:49.852003 run osmo-stp_10.42.42.5(pid=21578): ERR: Terminated: ERROR {rc=1} [trial-2401↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21578)] 07:15:49.988882 run osmo-stp_10.42.42.5(pid=21578): stdout: | (launched: 2022-12-14_07:15:48.580180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:50.126574 run osmo-stp_10.42.42.5(pid=21578): stderr: | 20221214071548770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071548770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071548770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071548770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071548771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071548771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071548771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:50.261700 run osmo-stp_10.42.42.5(pid=21578): stdout: | (launched: 2022-12-14_07:15:48.580180) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:50.390540 run osmo-stp_10.42.42.5(pid=21578): stderr: | 20221214071548770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071548770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071548770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071548770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071548771 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071548771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071548771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:50.544642 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=21578): Process ended prematurely: osmo-stp_10.42.42.5(pid=21578) [trial-2401↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21578)] [trial-2401↪ussd:trx-b200↪assert_extension.py:17] 07:15:50.553919 tst assert_extension.py:17: Test FAILED (6.1 sec) 07:15:50.581614 run osmo-hlr_10.42.42.2(pid=21575): ERR: Terminated: ERROR {rc=237} [trial-2401↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21575)] 07:15:50.633469 run osmo-hlr_10.42.42.2(pid=21575): stdout: | (launched: 2022-12-14_07:15:47.561768) 07:15:50.686605 run osmo-hlr_10.42.42.2(pid=21575): stderr: | 20221214071547756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071547756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071547756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071547756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071547756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071547756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071547770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071547778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071547778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071547779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:50.759829 run osmo-msc_10.42.42.6(pid=21581): ERR: Terminated: ERROR {rc=2} [trial-2401↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21581)] 07:15:50.810394 run osmo-msc_10.42.42.6(pid=21581): stdout: | (launched: 2022-12-14_07:15:49.611427) 07:15:50.863656 run osmo-msc_10.42.42.6(pid=21581): stderr: | 20221214071549927 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071549928 DLGLOBAL DEBUG validating counter group 0x7ff83d57bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071549928 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071549928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071549928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071549928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071549930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071549930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071549930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071549930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:50.916601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21574): Terminating (SIGTERM) 07:15:50.959464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21577): Terminating (SIGTERM) 07:15:51.002385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21580): Terminating (SIGTERM) 07:15:51.045508 --- ParallelTerminationStrategy: PID 21574 died... 07:15:51.066060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21574): Terminated: ok {rc=0} 07:15:51.112937 --- ParallelTerminationStrategy: PID 21577 died... 07:15:51.133495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21577): Terminated: ok {rc=0} 07:15:51.180038 --- ParallelTerminationStrategy: PID 21580 died... 07:15:51.200093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21580): Terminated: ok {rc=0} 07:15:51.289507 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:15:52.507080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:52.514423 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:15:52.549217 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:15:52.576891 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:15:52.631367 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:15:52.666330 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:15:52.694487 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:15:53.240694 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:15:53.291722 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:15:53.303084 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:15:53.373030 tst mo_mt_call.py: using LAC 39284 07:15:53.493406 tst mo_mt_call.py: using RAC 14 07:15:53.614651 tst mo_mt_call.py: using CellId 39284 07:15:53.738036 tst mo_mt_call.py: using BVCI 39285 07:15:53.848927 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:15:53.860105 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:15:53.871003 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:15:53.882003 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:15:53.893102 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:15:53.904033 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:15:54.026722 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:15:54.147908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:54.660671 run create_hlr_db(pid=21586): Launched 07:15:54.788108 bus /sierra_2: Setting Powered False 07:15:55.853127 run create_hlr_db(pid=21586): Terminated: ok {rc=0} 07:15:56.294350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21588): Launched 07:15:56.602741 run osmo-hlr_10.42.42.2(pid=21589): Launched 07:15:56.719433 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:57.248143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21591): Launched 07:15:57.556423 run osmo-stp_10.42.42.5(pid=21592): Launched 07:15:57.673543 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:58.227892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21594): Launched 07:15:58.536096 run osmo-msc_10.42.42.6(pid=21595): Launched 07:15:58.708366 run osmo-stp_10.42.42.5(pid=21592): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21592)] 07:15:58.838053 run osmo-stp_10.42.42.5(pid=21592): stdout: | (launched: 2022-12-14_07:15:57.499659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:58.967547 run osmo-stp_10.42.42.5(pid=21592): stderr: | 20221214071557669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071557669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071557669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071557670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071557670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071557670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071557670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:59.095319 run osmo-stp_10.42.42.5(pid=21592): stdout: | (launched: 2022-12-14_07:15:57.499659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:59.216689 run osmo-stp_10.42.42.5(pid=21592): stderr: | 20221214071557669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071557669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071557669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071557670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071557670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071557670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071557670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:59.363867 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21592): Process ended prematurely: osmo-stp_10.42.42.5(pid=21592) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21592)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:15:59.372778 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:15:59.398893 run osmo-hlr_10.42.42.2(pid=21589): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21589)] 07:15:59.446561 run osmo-hlr_10.42.42.2(pid=21589): stdout: | (launched: 2022-12-14_07:15:56.545824) 07:15:59.495943 run osmo-hlr_10.42.42.2(pid=21589): stderr: | 20221214071556719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071556719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071556719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071556719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071556720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071556720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071556731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071556739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071556740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071556740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:59.564647 run osmo-msc_10.42.42.6(pid=21595): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21595)] 07:15:59.612259 run osmo-msc_10.42.42.6(pid=21595): stdout: | (launched: 2022-12-14_07:15:58.479330) 07:15:59.661688 run osmo-msc_10.42.42.6(pid=21595): stderr: | 20221214071558750 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071558750 DLGLOBAL DEBUG validating counter group 0x7f0bc21b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071558751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071558751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071558751 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071558751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071558753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071558753 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071558753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071558753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:59.711510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21588): Terminating (SIGTERM) 07:15:59.751183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21591): Terminating (SIGTERM) 07:15:59.790939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21594): Terminating (SIGTERM) 07:15:59.830791 --- ParallelTerminationStrategy: PID 21588 died... 07:15:59.849726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21588): Terminated: ok {rc=0} 07:15:59.893649 --- ParallelTerminationStrategy: PID 21591 died... 07:15:59.912007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21591): Terminated: ok {rc=0} 07:15:59.955838 --- ParallelTerminationStrategy: PID 21594 died... 07:15:59.974426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21594): Terminated: ok {rc=0} 07:16:00.060200 bus /sierra_3: Setting Powered False 07:16:01.160892 bus /sierra_3: Setting Powered False 07:16:02.284192 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:16:03.433844 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:16:03.446225 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:16:03.518392 tst mo_mt_call_osmux.py: using LAC 39285 07:16:03.648284 tst mo_mt_call_osmux.py: using RAC 15 07:16:03.778086 tst mo_mt_call_osmux.py: using CellId 39285 07:16:03.907874 tst mo_mt_call_osmux.py: using BVCI 39286 07:16:04.029239 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:16:04.040856 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:16:04.052230 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:16:04.063640 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:16:04.075582 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:16:04.087318 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:16:04.209783 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:16:04.331797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:04.842407 run create_hlr_db(pid=21597): Launched 07:16:04.970401 bus /sierra_2: Setting Powered False 07:16:06.035479 run create_hlr_db(pid=21597): Terminated: ok {rc=0} 07:16:06.475533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21599): Launched 07:16:06.784061 run osmo-hlr_10.42.42.2(pid=21600): Launched 07:16:06.900042 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:07.447033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21602): Launched 07:16:07.754788 run osmo-stp_10.42.42.5(pid=21603): Launched 07:16:07.871337 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:08.426448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21605): Launched 07:16:08.733952 run osmo-msc_10.42.42.6(pid=21606): Launched 07:16:08.904891 run osmo-stp_10.42.42.5(pid=21603): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21603)] 07:16:09.033817 run osmo-stp_10.42.42.5(pid=21603): stdout: | (launched: 2022-12-14_07:16:07.697982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:09.163331 run osmo-stp_10.42.42.5(pid=21603): stderr: | 20221214071607867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071607867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071607867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071607867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071607868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071607868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071607868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:09.290604 run osmo-stp_10.42.42.5(pid=21603): stdout: | (launched: 2022-12-14_07:16:07.697982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:09.412416 run osmo-stp_10.42.42.5(pid=21603): stderr: | 20221214071607867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071607867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071607867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071607867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071607868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071607868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071607868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:09.558136 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21603): Process ended prematurely: osmo-stp_10.42.42.5(pid=21603) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21603)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:16:09.566964 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:16:09.593113 run osmo-hlr_10.42.42.2(pid=21600): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21600)] 07:16:09.640580 run osmo-hlr_10.42.42.2(pid=21600): stdout: | (launched: 2022-12-14_07:16:06.727164) 07:16:09.690146 run osmo-hlr_10.42.42.2(pid=21600): stderr: | 20221214071606900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071606900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071606900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071606900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071606900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071606900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071606912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071606921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071606922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071606922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:09.758967 run osmo-msc_10.42.42.6(pid=21606): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21606)] 07:16:09.806391 run osmo-msc_10.42.42.6(pid=21606): stdout: | (launched: 2022-12-14_07:16:08.676912) 07:16:09.855236 run osmo-msc_10.42.42.6(pid=21606): stderr: | 20221214071608946 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071608946 DLGLOBAL DEBUG validating counter group 0x7ffa13733c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071608946 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071608946 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071608947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071608947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071608948 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071608949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071608949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071608949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:09.905166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21599): Terminating (SIGTERM) 07:16:09.944837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21602): Terminating (SIGTERM) 07:16:09.984426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21605): Terminating (SIGTERM) 07:16:10.024195 --- ParallelTerminationStrategy: PID 21599 died... 07:16:10.043261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21599): Terminated: ok {rc=0} 07:16:10.087033 --- ParallelTerminationStrategy: PID 21602 died... 07:16:10.105580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21602): Terminated: ok {rc=0} 07:16:10.149284 --- ParallelTerminationStrategy: PID 21605 died... 07:16:10.167821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21605): Terminated: ok {rc=0} 07:16:10.253731 bus /sierra_3: Setting Powered False 07:16:11.353209 bus /sierra_3: Setting Powered False 07:16:12.470078 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:16:13.726625 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:16:13.734446 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:16:13.769907 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:16:13.797518 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:16:13.851211 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:16:13.885205 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:16:13.912831 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:16:14.463304 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:16:14.518364 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:14.530233 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:16:14.602381 tst mo_mt_call.py: using LAC 39286 07:16:14.733057 tst mo_mt_call.py: using RAC 16 07:16:14.863936 tst mo_mt_call.py: using CellId 39286 07:16:14.996132 tst mo_mt_call.py: using BVCI 39287 07:16:15.117808 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:15.129325 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:15.140615 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:15.152018 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:15.163857 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:15.175545 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:16:15.292438 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:16:15.414250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:15.960600 run create_hlr_db(pid=21611): Launched 07:16:16.120853 bus /sierra_2: Setting Powered False 07:16:17.200830 run create_hlr_db(pid=21611): Terminated: ok {rc=0} 07:16:17.647877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21613): Launched 07:16:17.956927 run osmo-hlr_10.42.42.2(pid=21614): Launched 07:16:18.072941 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:18.618017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21616): Launched 07:16:18.929561 run osmo-stp_10.42.42.5(pid=21617): Launched 07:16:19.046493 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:19.606515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21619): Launched 07:16:19.914594 run osmo-msc_10.42.42.6(pid=21620): Launched 07:16:20.085972 run osmo-stp_10.42.42.5(pid=21617): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21617)] 07:16:20.215529 run osmo-stp_10.42.42.5(pid=21617): stdout: | (launched: 2022-12-14_07:16:18.872355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:20.345395 run osmo-stp_10.42.42.5(pid=21617): stderr: | 20221214071619041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071619041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071619042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071619042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071619043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071619043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071619043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:20.472867 run osmo-stp_10.42.42.5(pid=21617): stdout: | (launched: 2022-12-14_07:16:18.872355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:20.594634 run osmo-stp_10.42.42.5(pid=21617): stderr: | 20221214071619041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071619041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071619042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071619042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071619043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071619043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071619043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:20.740266 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21617): Process ended prematurely: osmo-stp_10.42.42.5(pid=21617) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21617)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:16:20.749266 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:16:20.775648 run osmo-hlr_10.42.42.2(pid=21614): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21614)] 07:16:20.823513 run osmo-hlr_10.42.42.2(pid=21614): stdout: | (launched: 2022-12-14_07:16:17.899671) 07:16:20.873291 run osmo-hlr_10.42.42.2(pid=21614): stderr: | 20221214071618076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071618076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071618076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071618076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071618076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071618076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071618088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071618096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071618096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071618096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:20.943074 run osmo-msc_10.42.42.6(pid=21620): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21620)] 07:16:20.990872 run osmo-msc_10.42.42.6(pid=21620): stdout: | (launched: 2022-12-14_07:16:19.857511) 07:16:21.040193 run osmo-msc_10.42.42.6(pid=21620): stderr: | 20221214071620128 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071620128 DLGLOBAL DEBUG validating counter group 0x7f428e50fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071620128 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071620128 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071620129 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071620129 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071620131 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071620131 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071620131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071620131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:21.089794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21613): Terminating (SIGTERM) 07:16:21.129985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21616): Terminating (SIGTERM) 07:16:21.170091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21619): Terminating (SIGTERM) 07:16:21.210289 --- ParallelTerminationStrategy: PID 21613 died... 07:16:21.229499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21613): Terminated: ok {rc=0} 07:16:21.273634 --- ParallelTerminationStrategy: PID 21616 died... 07:16:21.292213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21616): Terminated: ok {rc=0} 07:16:21.336014 --- ParallelTerminationStrategy: PID 21619 died... 07:16:21.354883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21619): Terminated: ok {rc=0} 07:16:21.440923 bus /sierra_3: Setting Powered False 07:16:22.540222 bus /sierra_3: Setting Powered False 07:16:23.653816 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:16:24.804660 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:24.817188 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:16:24.889147 tst mo_mt_call_osmux.py: using LAC 39287 07:16:25.021471 tst mo_mt_call_osmux.py: using RAC 17 07:16:25.142598 tst mo_mt_call_osmux.py: using CellId 39287 07:16:25.264359 tst mo_mt_call_osmux.py: using BVCI 39288 07:16:25.375598 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:25.386908 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:25.397883 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:25.409121 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:25.420217 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:16:25.431147 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:16:25.553815 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:16:25.676127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:26.189609 run create_hlr_db(pid=21622): Launched 07:16:26.316335 bus /sierra_2: Setting Powered False 07:16:27.381326 run create_hlr_db(pid=21622): Terminated: ok {rc=0} 07:16:27.843325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21624): Launched 07:16:28.175103 run osmo-hlr_10.42.42.2(pid=21625): Launched 07:16:28.302024 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:28.877104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21627): Launched 07:16:29.208928 run osmo-stp_10.42.42.5(pid=21628): Launched 07:16:29.335374 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:29.937204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21630): Launched 07:16:30.270828 run osmo-msc_10.42.42.6(pid=21631): Launched 07:16:30.456486 run osmo-stp_10.42.42.5(pid=21628): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21628)] 07:16:30.595592 run osmo-stp_10.42.42.5(pid=21628): stdout: | (launched: 2022-12-14_07:16:29.148520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:30.735867 run osmo-stp_10.42.42.5(pid=21628): stderr: | 20221214071629339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071629339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071629339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071629339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071629340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071629340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071629340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:30.877159 run osmo-stp_10.42.42.5(pid=21628): stdout: | (launched: 2022-12-14_07:16:29.148520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:31.011912 run osmo-stp_10.42.42.5(pid=21628): stderr: | 20221214071629339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071629339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071629339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071629339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071629340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071629340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071629340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:31.173498 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21628): Process ended prematurely: osmo-stp_10.42.42.5(pid=21628) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21628)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:16:31.184097 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:16:31.213208 run osmo-hlr_10.42.42.2(pid=21625): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21625)] 07:16:31.268243 run osmo-hlr_10.42.42.2(pid=21625): stdout: | (launched: 2022-12-14_07:16:28.114548) 07:16:31.323420 run osmo-hlr_10.42.42.2(pid=21625): stderr: | 20221214071628309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071628309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071628309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071628309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071628309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071628309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071628322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071628331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071628331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071628332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:31.399375 run osmo-msc_10.42.42.6(pid=21631): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21631)] 07:16:31.452269 run osmo-msc_10.42.42.6(pid=21631): stdout: | (launched: 2022-12-14_07:16:30.210081) 07:16:31.506955 run osmo-msc_10.42.42.6(pid=21631): stderr: | 20221214071630528 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071630529 DLGLOBAL DEBUG validating counter group 0x7fb06875bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071630529 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071630529 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071630529 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071630529 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071630531 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071630531 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071630531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071630531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:31.562414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21624): Terminating (SIGTERM) 07:16:31.605891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21627): Terminating (SIGTERM) 07:16:31.650721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21630): Terminating (SIGTERM) 07:16:31.696918 --- ParallelTerminationStrategy: PID 21624 died... 07:16:31.719002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21624): Terminated: ok {rc=0} 07:16:31.769773 --- ParallelTerminationStrategy: PID 21627 died... 07:16:31.790249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21627): Terminated: ok {rc=0} 07:16:31.839717 --- ParallelTerminationStrategy: PID 21630 died... 07:16:31.860272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21630): Terminated: ok {rc=0} 07:16:31.955306 bus /sierra_3: Setting Powered False 07:16:33.066623 bus /sierra_3: Setting Powered False 07:16:34.185922 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:16:35.436408 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:16:35.442921 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:16:35.475515 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:16:35.502016 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:16:35.553786 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:16:35.588150 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:16:35.615670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:16:36.163140 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:16:36.212856 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:36.224310 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:16:36.293787 tst mo_mt_call.py: using LAC 39288 07:16:36.416999 tst mo_mt_call.py: using RAC 18 07:16:36.537351 tst mo_mt_call.py: using CellId 39288 07:16:36.659183 tst mo_mt_call.py: using BVCI 39289 07:16:36.773474 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:36.784681 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:36.795587 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:36.806488 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:36.817545 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:36.828930 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:16:36.951904 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:16:37.071624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:37.549387 run create_hlr_db(pid=21636): Launched 07:16:37.676012 bus /sierra_2: Setting Powered False 07:16:38.736558 run create_hlr_db(pid=21636): Terminated: ok {rc=0} 07:16:39.189423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21638): Launched 07:16:39.523107 run osmo-hlr_10.42.42.2(pid=21639): Launched 07:16:39.651146 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:40.208492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21641): Launched 07:16:40.518041 run osmo-stp_10.42.42.5(pid=21642): Launched 07:16:40.634675 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:41.191004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21644): Launched 07:16:41.499842 run osmo-msc_10.42.42.6(pid=21645): Launched 07:16:41.672755 run osmo-stp_10.42.42.5(pid=21642): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21642)] 07:16:41.802393 run osmo-stp_10.42.42.5(pid=21642): stdout: | (launched: 2022-12-14_07:16:40.460653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:41.931814 run osmo-stp_10.42.42.5(pid=21642): stderr: | 20221214071640629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071640629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071640630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071640630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071640630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071640631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071640631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:42.059877 run osmo-stp_10.42.42.5(pid=21642): stdout: | (launched: 2022-12-14_07:16:40.460653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:42.181694 run osmo-stp_10.42.42.5(pid=21642): stderr: | 20221214071640629 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071640629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071640630 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071640630 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071640630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071640631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071640631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:42.328050 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21642): Process ended prematurely: osmo-stp_10.42.42.5(pid=21642) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21642)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:16:42.336879 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:16:42.363086 run osmo-hlr_10.42.42.2(pid=21639): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21639)] 07:16:42.410520 run osmo-hlr_10.42.42.2(pid=21639): stdout: | (launched: 2022-12-14_07:16:39.462271) 07:16:42.459911 run osmo-hlr_10.42.42.2(pid=21639): stderr: | 20221214071639657 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071639657 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071639657 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071639658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071639658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071639658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071639670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071639678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071639678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071639678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:42.528436 run osmo-msc_10.42.42.6(pid=21645): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21645)] 07:16:42.575965 run osmo-msc_10.42.42.6(pid=21645): stdout: | (launched: 2022-12-14_07:16:41.443025) 07:16:42.625031 run osmo-msc_10.42.42.6(pid=21645): stderr: | 20221214071641713 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071641713 DLGLOBAL DEBUG validating counter group 0x7f1550ae2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071641713 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071641713 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071641713 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071641714 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071641715 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071641716 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071641716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071641716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:42.674465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21638): Terminating (SIGTERM) 07:16:42.714342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21641): Terminating (SIGTERM) 07:16:42.753965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21644): Terminating (SIGTERM) 07:16:42.793744 --- ParallelTerminationStrategy: PID 21638 died... 07:16:42.812748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21638): Terminated: ok {rc=0} 07:16:42.856566 --- ParallelTerminationStrategy: PID 21641 died... 07:16:42.875072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21641): Terminated: ok {rc=0} 07:16:42.918580 --- ParallelTerminationStrategy: PID 21644 died... 07:16:42.937299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21644): Terminated: ok {rc=0} 07:16:43.022903 bus /sierra_3: Setting Powered False 07:16:44.123147 bus /sierra_3: Setting Powered False 07:16:45.238327 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:16:46.386222 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:46.399216 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:16:46.493034 tst mo_mt_call_osmux.py: using LAC 39289 07:16:46.658194 tst mo_mt_call_osmux.py: using RAC 19 07:16:46.779820 tst mo_mt_call_osmux.py: using CellId 39289 07:16:46.901656 tst mo_mt_call_osmux.py: using BVCI 39290 07:16:47.018373 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:47.030464 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:47.042561 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:47.054532 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:47.066819 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:16:47.078548 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:16:47.227002 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:16:47.349345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:47.829533 run create_hlr_db(pid=21647): Launched 07:16:47.956779 bus /sierra_2: Setting Powered False 07:16:49.017540 run create_hlr_db(pid=21647): Terminated: ok {rc=0} 07:16:49.468284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21649): Launched 07:16:49.800667 run osmo-hlr_10.42.42.2(pid=21650): Launched 07:16:49.926010 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:50.493411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21652): Launched 07:16:50.825574 run osmo-stp_10.42.42.5(pid=21653): Launched 07:16:50.953182 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:51.553817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21655): Launched 07:16:51.887580 run osmo-msc_10.42.42.6(pid=21656): Launched 07:16:52.075259 run osmo-stp_10.42.42.5(pid=21653): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21653)] 07:16:52.217249 run osmo-stp_10.42.42.5(pid=21653): stdout: | (launched: 2022-12-14_07:16:50.764824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:52.353703 run osmo-stp_10.42.42.5(pid=21653): stderr: | 20221214071650955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071650955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071650955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071650956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071650956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071650956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071650956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:52.491231 run osmo-stp_10.42.42.5(pid=21653): stdout: | (launched: 2022-12-14_07:16:50.764824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:52.622564 run osmo-stp_10.42.42.5(pid=21653): stderr: | 20221214071650955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071650955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071650955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071650956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071650956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071650956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071650956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:52.779930 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21653): Process ended prematurely: osmo-stp_10.42.42.5(pid=21653) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21653)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:16:52.789562 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:16:52.817461 run osmo-hlr_10.42.42.2(pid=21650): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21650)] 07:16:52.868541 run osmo-hlr_10.42.42.2(pid=21650): stdout: | (launched: 2022-12-14_07:16:49.740086) 07:16:52.921153 run osmo-hlr_10.42.42.2(pid=21650): stderr: | 20221214071649935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071649935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071649935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071649935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071649935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071649936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071649981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071649990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071649990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071649990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:52.994042 run osmo-msc_10.42.42.6(pid=21656): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21656)] 07:16:53.044093 run osmo-msc_10.42.42.6(pid=21656): stdout: | (launched: 2022-12-14_07:16:51.826661) 07:16:53.096513 run osmo-msc_10.42.42.6(pid=21656): stderr: | 20221214071652148 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071652148 DLGLOBAL DEBUG validating counter group 0x7f1b110dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071652148 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071652148 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071652148 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071652149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071652150 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071652151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071652151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071652151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:53.149338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21649): Terminating (SIGTERM) 07:16:53.191620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21652): Terminating (SIGTERM) 07:16:53.234054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21655): Terminating (SIGTERM) 07:16:53.276815 --- ParallelTerminationStrategy: PID 21649 died... 07:16:53.297368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21649): Terminated: ok {rc=0} 07:16:53.343926 --- ParallelTerminationStrategy: PID 21652 died... 07:16:53.363901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21652): Terminated: ok {rc=0} 07:16:53.410794 --- ParallelTerminationStrategy: PID 21655 died... 07:16:53.430844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21655): Terminated: ok {rc=0} 07:16:53.519251 bus /sierra_3: Setting Powered False 07:16:54.617482 bus /sierra_3: Setting Powered False 07:16:55.736540 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:16:56.992836 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:16:57.000445 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:16:57.035652 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:16:57.063931 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:16:57.119684 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:16:57.154768 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:16:57.182677 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:16:57.730821 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:16:57.785085 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:16:57.796823 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:16:57.868294 tst mo_mt_call.py: using LAC 39290 07:16:57.999344 tst mo_mt_call.py: using RAC 20 07:16:58.130209 tst mo_mt_call.py: using CellId 39290 07:16:58.259987 tst mo_mt_call.py: using BVCI 39291 07:16:58.380201 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:16:58.391929 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:16:58.403476 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:16:58.415108 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:16:58.427198 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:16:58.439277 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:16:58.559369 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:16:58.681794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:59.194125 run create_hlr_db(pid=21661): Launched 07:16:59.320082 bus /sierra_2: Setting Powered False 07:17:00.384826 run create_hlr_db(pid=21661): Terminated: ok {rc=0} 07:17:00.833688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21663): Launched 07:17:01.183493 run osmo-hlr_10.42.42.2(pid=21664): Launched 07:17:01.363922 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:02.093348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21669): Launched 07:17:02.449661 run osmo-stp_10.42.42.5(pid=21670): Launched 07:17:02.578553 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:03.185875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21672): Launched 07:17:03.519030 run osmo-msc_10.42.42.6(pid=21673): Launched 07:17:03.704929 run osmo-stp_10.42.42.5(pid=21670): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21670)] 07:17:03.843419 run osmo-stp_10.42.42.5(pid=21670): stdout: | (launched: 2022-12-14_07:17:02.388798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:03.983474 run osmo-stp_10.42.42.5(pid=21670): stderr: | 20221214071702578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071702579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071702579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071702579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071702580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071702580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071702580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:04.122205 run osmo-stp_10.42.42.5(pid=21670): stdout: | (launched: 2022-12-14_07:17:02.388798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:04.254072 run osmo-stp_10.42.42.5(pid=21670): stderr: | 20221214071702578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071702579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071702579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071702579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071702580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071702580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071702580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:04.411694 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21670): Process ended prematurely: osmo-stp_10.42.42.5(pid=21670) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21670)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:17:04.421633 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 07:17:04.449562 run osmo-hlr_10.42.42.2(pid=21664): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21664)] 07:17:04.500915 run osmo-hlr_10.42.42.2(pid=21664): stdout: | (launched: 2022-12-14_07:17:01.120049) 07:17:04.553765 run osmo-hlr_10.42.42.2(pid=21664): stderr: | 20221214071701478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071701478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071701478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071701478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071701478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071701478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071701502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071701510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071701510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071701510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:04.626344 run osmo-msc_10.42.42.6(pid=21673): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21673)] 07:17:04.676306 run osmo-msc_10.42.42.6(pid=21673): stdout: | (launched: 2022-12-14_07:17:03.458336) 07:17:04.729277 run osmo-msc_10.42.42.6(pid=21673): stderr: | 20221214071703779 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071703779 DLGLOBAL DEBUG validating counter group 0x7f9258701c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071703780 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071703780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071703780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071703780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071703782 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071703782 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071703782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071703782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:04.781956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21663): Terminating (SIGTERM) 07:17:04.824029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21669): Terminating (SIGTERM) 07:17:04.866702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21672): Terminating (SIGTERM) 07:17:04.909483 --- ParallelTerminationStrategy: PID 21663 died... 07:17:04.930195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21663): Terminated: ok {rc=0} 07:17:04.977202 --- ParallelTerminationStrategy: PID 21669 died... 07:17:04.997818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21669): Terminated: ok {rc=0} 07:17:05.044695 --- ParallelTerminationStrategy: PID 21672 died... 07:17:05.064866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21672): Terminated: ok {rc=0} 07:17:05.154726 bus /sierra_3: Setting Powered False 07:17:06.254449 bus /sierra_3: Setting Powered False 07:17:07.372248 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:17:08.523541 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:17:08.536296 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:17:08.608072 tst mo_mt_call_osmux.py: using LAC 39291 07:17:08.745094 tst mo_mt_call_osmux.py: using RAC 21 07:17:08.874510 tst mo_mt_call_osmux.py: using CellId 39291 07:17:09.003264 tst mo_mt_call_osmux.py: using BVCI 39292 07:17:09.123923 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:17:09.135757 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:17:09.147318 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:17:09.158737 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:17:09.170647 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:17:09.182463 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:17:09.305345 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:17:09.424510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:09.904422 run create_hlr_db(pid=21675): Launched 07:17:10.029936 bus /sierra_2: Setting Powered False 07:17:11.092112 run create_hlr_db(pid=21675): Terminated: ok {rc=0} 07:17:11.543940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21677): Launched 07:17:11.875972 run osmo-hlr_10.42.42.2(pid=21678): Launched 07:17:12.003618 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:12.572768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21680): Launched 07:17:12.903557 run osmo-stp_10.42.42.5(pid=21681): Launched 07:17:13.031231 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:13.627687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21683): Launched 07:17:13.961250 run osmo-msc_10.42.42.6(pid=21684): Launched 07:17:14.146502 run osmo-stp_10.42.42.5(pid=21681): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21681)] 07:17:14.286060 run osmo-stp_10.42.42.5(pid=21681): stdout: | (launched: 2022-12-14_07:17:12.843179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:14.426242 run osmo-stp_10.42.42.5(pid=21681): stderr: | 20221214071713033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071713033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071713033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071713033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071713034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071713034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071713034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:14.564406 run osmo-stp_10.42.42.5(pid=21681): stdout: | (launched: 2022-12-14_07:17:12.843179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:14.695869 run osmo-stp_10.42.42.5(pid=21681): stderr: | 20221214071713033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071713033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071713033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071713033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071713034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071713034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071713034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:14.854153 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21681): Process ended prematurely: osmo-stp_10.42.42.5(pid=21681) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21681)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:17:14.863918 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:17:14.892074 run osmo-hlr_10.42.42.2(pid=21678): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21678)] 07:17:14.943539 run osmo-hlr_10.42.42.2(pid=21678): stdout: | (launched: 2022-12-14_07:17:11.815356) 07:17:14.997072 run osmo-hlr_10.42.42.2(pid=21678): stderr: | 20221214071712011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071712011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071712011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071712011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071712012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071712012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071712024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071712033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071712033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071712033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:15.070213 run osmo-msc_10.42.42.6(pid=21684): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21684)] 07:17:15.120427 run osmo-msc_10.42.42.6(pid=21684): stdout: | (launched: 2022-12-14_07:17:13.900112) 07:17:15.173518 run osmo-msc_10.42.42.6(pid=21684): stderr: | 20221214071714219 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071714219 DLGLOBAL DEBUG validating counter group 0x7f2538010c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071714220 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071714220 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071714220 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071714220 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071714222 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071714223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071714223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071714223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:15.226893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21677): Terminating (SIGTERM) 07:17:15.269311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21680): Terminating (SIGTERM) 07:17:15.312181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21683): Terminating (SIGTERM) 07:17:15.355292 --- ParallelTerminationStrategy: PID 21677 died... 07:17:15.376111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21677): Terminated: ok {rc=0} 07:17:15.423701 --- ParallelTerminationStrategy: PID 21680 died... 07:17:15.443942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21680): Terminated: ok {rc=0} 07:17:15.490580 --- ParallelTerminationStrategy: PID 21683 died... 07:17:15.510893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21683): Terminated: ok {rc=0} 07:17:15.599552 bus /sierra_3: Setting Powered False 07:17:16.702902 bus /sierra_3: Setting Powered False 07:17:17.824407 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:17:19.078576 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:17:19.085927 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:17:19.119777 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:17:19.148089 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:17:19.202691 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:17:19.237153 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:17:19.264499 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:17:19.814548 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:17:19.867991 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:19.879750 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:17:19.951847 tst mo_mt_call.py: using LAC 39292 07:17:20.074857 tst mo_mt_call.py: using RAC 22 07:17:20.204612 tst mo_mt_call.py: using CellId 39292 07:17:20.334127 tst mo_mt_call.py: using BVCI 39293 07:17:20.447089 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:20.458355 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:20.469347 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:20.480336 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:20.491417 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:20.502439 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:17:20.626375 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:17:20.750395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:21.262203 run create_hlr_db(pid=21689): Launched 07:17:21.389687 bus /sierra_2: Setting Powered False 07:17:22.454608 run create_hlr_db(pid=21689): Terminated: ok {rc=0} 07:17:22.894499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21691): Launched 07:17:23.204422 run osmo-hlr_10.42.42.2(pid=21692): Launched 07:17:23.321862 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:23.851413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21694): Launched 07:17:24.162069 run osmo-stp_10.42.42.5(pid=21695): Launched 07:17:24.278627 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:24.833285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21697): Launched 07:17:25.141727 run osmo-msc_10.42.42.6(pid=21698): Launched 07:17:25.312222 run osmo-stp_10.42.42.5(pid=21695): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21695)] 07:17:25.442253 run osmo-stp_10.42.42.5(pid=21695): stdout: | (launched: 2022-12-14_07:17:24.104841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:25.571721 run osmo-stp_10.42.42.5(pid=21695): stderr: | 20221214071724274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071724274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071724274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071724275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071724275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071724275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071724275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:25.699968 run osmo-stp_10.42.42.5(pid=21695): stdout: | (launched: 2022-12-14_07:17:24.104841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:25.822943 run osmo-stp_10.42.42.5(pid=21695): stderr: | 20221214071724274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071724274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071724274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071724275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071724275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071724275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071724275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:25.969739 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21695): Process ended prematurely: osmo-stp_10.42.42.5(pid=21695) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21695)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:17:25.978936 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:17:26.005602 run osmo-hlr_10.42.42.2(pid=21692): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21692)] 07:17:26.053712 run osmo-hlr_10.42.42.2(pid=21692): stdout: | (launched: 2022-12-14_07:17:23.146630) 07:17:26.103458 run osmo-hlr_10.42.42.2(pid=21692): stderr: | 20221214071723323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071723323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071723323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071723323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071723323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071723323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071723340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071723349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071723350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071723350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:26.172798 run osmo-msc_10.42.42.6(pid=21698): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21698)] 07:17:26.220602 run osmo-msc_10.42.42.6(pid=21698): stdout: | (launched: 2022-12-14_07:17:25.084617) 07:17:26.270002 run osmo-msc_10.42.42.6(pid=21698): stderr: | 20221214071725355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071725355 DLGLOBAL DEBUG validating counter group 0x7fcff192dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071725355 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071725355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071725356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071725356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071725357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071725358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071725358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071725358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:26.319894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21691): Terminating (SIGTERM) 07:17:26.359905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21694): Terminating (SIGTERM) 07:17:26.399775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21697): Terminating (SIGTERM) 07:17:26.440017 --- ParallelTerminationStrategy: PID 21691 died... 07:17:26.459997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21691): Terminated: ok {rc=0} 07:17:26.504606 --- ParallelTerminationStrategy: PID 21694 died... 07:17:26.523741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21694): Terminated: ok {rc=0} 07:17:26.568396 --- ParallelTerminationStrategy: PID 21697 died... 07:17:26.587650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21697): Terminated: ok {rc=0} 07:17:26.674019 bus /sierra_3: Setting Powered False 07:17:27.775512 bus /sierra_3: Setting Powered False 07:17:28.893510 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:17:30.042093 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:30.053988 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:17:30.123989 tst mo_mt_call_osmux.py: using LAC 39293 07:17:30.246923 tst mo_mt_call_osmux.py: using RAC 23 07:17:30.371152 tst mo_mt_call_osmux.py: using CellId 39293 07:17:30.494084 tst mo_mt_call_osmux.py: using BVCI 39294 07:17:30.608012 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:30.619222 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:30.630214 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:30.641191 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:30.652292 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:17:30.663304 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:17:30.786467 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:17:30.935566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:31.439339 run create_hlr_db(pid=21700): Launched 07:17:31.602812 bus /sierra_2: Setting Powered False 07:17:32.667835 run create_hlr_db(pid=21700): Terminated: ok {rc=0} 07:17:33.115836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21702): Launched 07:17:33.449952 run osmo-hlr_10.42.42.2(pid=21703): Launched 07:17:33.577924 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:34.152509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21705): Launched 07:17:34.485333 run osmo-stp_10.42.42.5(pid=21706): Launched 07:17:34.613102 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:35.210995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21708): Launched 07:17:35.544603 run osmo-msc_10.42.42.6(pid=21709): Launched 07:17:35.728890 run osmo-stp_10.42.42.5(pid=21706): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21706)] 07:17:35.868753 run osmo-stp_10.42.42.5(pid=21706): stdout: | (launched: 2022-12-14_07:17:34.424234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:36.009248 run osmo-stp_10.42.42.5(pid=21706): stderr: | 20221214071734615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071734615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071734615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071734616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071734616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071734616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071734616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:36.147695 run osmo-stp_10.42.42.5(pid=21706): stdout: | (launched: 2022-12-14_07:17:34.424234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:36.279299 run osmo-stp_10.42.42.5(pid=21706): stderr: | 20221214071734615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071734615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071734615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071734616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071734616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071734616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071734616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:36.436929 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21706): Process ended prematurely: osmo-stp_10.42.42.5(pid=21706) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21706)] [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:17:36.446727 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:17:36.474664 run osmo-hlr_10.42.42.2(pid=21703): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21703)] 07:17:36.525432 run osmo-hlr_10.42.42.2(pid=21703): stdout: | (launched: 2022-12-14_07:17:33.389083) 07:17:36.577674 run osmo-hlr_10.42.42.2(pid=21703): stderr: | 20221214071733586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071733586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071733586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071733586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071733586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071733586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071733598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071733609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071733609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071733609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:36.650827 run osmo-msc_10.42.42.6(pid=21709): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21709)] 07:17:36.701138 run osmo-msc_10.42.42.6(pid=21709): stdout: | (launched: 2022-12-14_07:17:35.483546) 07:17:36.753747 run osmo-msc_10.42.42.6(pid=21709): stderr: | 20221214071735803 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071735803 DLGLOBAL DEBUG validating counter group 0x7f36a8b38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071735804 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071735804 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071735804 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071735804 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071735806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071735806 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071735806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071735806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:36.806112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21702): Terminating (SIGTERM) 07:17:36.848186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21705): Terminating (SIGTERM) 07:17:36.890740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21708): Terminating (SIGTERM) 07:17:36.933422 --- ParallelTerminationStrategy: PID 21702 died... 07:17:36.953792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21702): Terminated: ok {rc=0} 07:17:37.000514 --- ParallelTerminationStrategy: PID 21705 died... 07:17:37.020759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21705): Terminated: ok {rc=0} 07:17:37.067187 --- ParallelTerminationStrategy: PID 21708 died... 07:17:37.087150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21708): Terminated: ok {rc=0} 07:17:37.175465 bus /sierra_3: Setting Powered False 07:17:38.275198 bus /sierra_3: Setting Powered False 07:17:39.391720 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:17:40.643867 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:17:40.651233 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:17:40.685346 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:17:40.713702 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:17:40.765397 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:17:40.805727 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:17:40.835190 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:17:41.383983 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:17:41.438749 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:41.450656 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:17:41.522389 tst mo_mt_call.py: using LAC 39294 07:17:41.646292 tst mo_mt_call.py: using RAC 24 07:17:41.769045 tst mo_mt_call.py: using CellId 39294 07:17:41.892588 tst mo_mt_call.py: using BVCI 39295 07:17:42.007226 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:42.018521 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:42.029709 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:42.040631 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:42.051699 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:42.062727 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:17:42.184507 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:17:42.303335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:42.783260 run create_hlr_db(pid=21720): Launched 07:17:42.908384 bus /sierra_2: Setting Powered False 07:17:43.969823 run create_hlr_db(pid=21720): Terminated: ok {rc=0} 07:17:44.420756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21722): Launched 07:17:44.754141 run osmo-hlr_10.42.42.2(pid=21723): Launched 07:17:44.879241 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:45.451179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21725): Launched 07:17:45.765595 run osmo-stp_10.42.42.5(pid=21726): Launched 07:17:45.911194 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:46.563132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21728): Launched 07:17:46.886147 run osmo-msc_10.42.42.6(pid=21729): Launched 07:17:47.255073 run osmo-stp_10.42.42.5(pid=21726): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21726)] 07:17:47.394210 run osmo-stp_10.42.42.5(pid=21726): stdout: | (launched: 2022-12-14_07:17:45.708445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:47.534579 run osmo-stp_10.42.42.5(pid=21726): stderr: | 20221214071745945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071745945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071745945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071745946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071745946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071745946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071745946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:47.672146 run osmo-stp_10.42.42.5(pid=21726): stdout: | (launched: 2022-12-14_07:17:45.708445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:47.803311 run osmo-stp_10.42.42.5(pid=21726): stderr: | 20221214071745945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071745945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071745945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071745946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071745946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071745946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071745946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:47.960610 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21726): Process ended prematurely: osmo-stp_10.42.42.5(pid=21726) [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21726)] [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:17:47.970216 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:17:47.997964 run osmo-hlr_10.42.42.2(pid=21723): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21723)] 07:17:48.049432 run osmo-hlr_10.42.42.2(pid=21723): stdout: | (launched: 2022-12-14_07:17:44.692676) 07:17:48.101921 run osmo-hlr_10.42.42.2(pid=21723): stderr: | 20221214071744888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071744888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071744888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071744888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071744888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071744888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071744900 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071744909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071744909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071744909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:48.174681 run osmo-msc_10.42.42.6(pid=21729): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21729)] 07:17:48.224649 run osmo-msc_10.42.42.6(pid=21729): stdout: | (launched: 2022-12-14_07:17:46.828779) 07:17:48.277191 run osmo-msc_10.42.42.6(pid=21729): stderr: | 20221214071747278 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071747279 DLGLOBAL DEBUG validating counter group 0x7fd0488b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071747279 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071747279 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071747279 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071747279 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071747281 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071747281 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071747282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071747282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:48.329854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21722): Terminating (SIGTERM) 07:17:48.371760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21725): Terminating (SIGTERM) 07:17:48.414519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21728): Terminating (SIGTERM) 07:17:48.456868 --- ParallelTerminationStrategy: PID 21722 died... 07:17:48.477335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21722): Terminated: ok {rc=0} 07:17:48.523915 --- ParallelTerminationStrategy: PID 21725 died... 07:17:48.543754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21725): Terminated: ok {rc=0} 07:17:48.590036 --- ParallelTerminationStrategy: PID 21728 died... 07:17:48.609942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21728): Terminated: ok {rc=0} 07:17:48.698475 bus /sierra_3: Setting Powered False 07:17:49.797853 bus /sierra_3: Setting Powered False 07:17:50.915748 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:17:52.067784 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:52.080229 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:17:52.152196 tst mo_mt_call_osmux.py: using LAC 39295 07:17:52.275116 tst mo_mt_call_osmux.py: using RAC 25 07:17:52.397385 tst mo_mt_call_osmux.py: using CellId 39295 07:17:52.518445 tst mo_mt_call_osmux.py: using BVCI 39296 07:17:52.632717 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:52.643981 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:52.654938 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:52.665933 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:52.676898 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:17:52.687956 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:17:52.810443 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:17:52.930072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:53.410629 run create_hlr_db(pid=21731): Launched 07:17:53.537632 bus /sierra_2: Setting Powered False 07:17:54.598591 run create_hlr_db(pid=21731): Terminated: ok {rc=0} 07:17:55.052011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21733): Launched 07:17:55.386648 run osmo-hlr_10.42.42.2(pid=21734): Launched 07:17:55.514051 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:56.092483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21736): Launched 07:17:56.424265 run osmo-stp_10.42.42.5(pid=21737): Launched 07:17:56.550727 run osmo-msc_10.42.42.6: Starting osmo-msc 07:17:57.150245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21739): Launched 07:17:57.483492 run osmo-msc_10.42.42.6(pid=21740): Launched 07:17:57.670178 run osmo-stp_10.42.42.5(pid=21737): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21737)] 07:17:57.809670 run osmo-stp_10.42.42.5(pid=21737): stdout: | (launched: 2022-12-14_07:17:56.363479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:57.950544 run osmo-stp_10.42.42.5(pid=21737): stderr: | 20221214071756552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071756553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071756553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071756553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071756554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071756554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071756554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:58.089462 run osmo-stp_10.42.42.5(pid=21737): stdout: | (launched: 2022-12-14_07:17:56.363479) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:58.221560 run osmo-stp_10.42.42.5(pid=21737): stderr: | 20221214071756552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071756553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071756553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071756553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071756554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071756554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071756554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:58.379824 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21737): Process ended prematurely: osmo-stp_10.42.42.5(pid=21737) [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21737)] [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:17:58.389536 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:17:58.417315 run osmo-hlr_10.42.42.2(pid=21734): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21734)] 07:17:58.468781 run osmo-hlr_10.42.42.2(pid=21734): stdout: | (launched: 2022-12-14_07:17:55.325757) 07:17:58.521485 run osmo-hlr_10.42.42.2(pid=21734): stderr: | 20221214071755521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071755521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071755521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071755521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071755521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071755521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071755536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071755545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071755545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071755545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:58.594695 run osmo-msc_10.42.42.6(pid=21740): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21740)] 07:17:58.644635 run osmo-msc_10.42.42.6(pid=21740): stdout: | (launched: 2022-12-14_07:17:57.422417) 07:17:58.697153 run osmo-msc_10.42.42.6(pid=21740): stderr: | 20221214071757741 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071757741 DLGLOBAL DEBUG validating counter group 0x7f17c5cbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071757741 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071757741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071757741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071757741 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071757743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071757743 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071757743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071757744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:17:58.749692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21733): Terminating (SIGTERM) 07:17:58.791457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21736): Terminating (SIGTERM) 07:17:58.833890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21739): Terminating (SIGTERM) 07:17:58.876484 --- ParallelTerminationStrategy: PID 21733 died... 07:17:58.896839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21733): Terminated: ok {rc=0} 07:17:58.943621 --- ParallelTerminationStrategy: PID 21736 died... 07:17:58.963628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21736): Terminated: ok {rc=0} 07:17:59.009813 --- ParallelTerminationStrategy: PID 21739 died... 07:17:59.029807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21739): Terminated: ok {rc=0} 07:17:59.117629 bus /sierra_3: Setting Powered False 07:18:00.215888 bus /sierra_3: Setting Powered False 07:18:01.334631 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:18:02.590944 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:18:02.597255 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:18:02.632058 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:18:02.659681 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:18:02.713675 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:18:02.748265 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:18:02.776112 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:18:03.324663 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:18:03.378477 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:03.389921 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:18:03.464243 tst mo_mt_call.py: using LAC 39296 07:18:03.593695 tst mo_mt_call.py: using RAC 26 07:18:03.722572 tst mo_mt_call.py: using CellId 39296 07:18:03.850331 tst mo_mt_call.py: using BVCI 39297 07:18:03.971419 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:03.982878 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:03.994083 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:04.005261 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:04.016750 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:04.028665 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:18:04.148221 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:18:04.265952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:04.745738 run create_hlr_db(pid=21745): Launched 07:18:04.873402 bus /sierra_2: Setting Powered False 07:18:05.934173 run create_hlr_db(pid=21745): Terminated: ok {rc=0} 07:18:06.364827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21747): Launched 07:18:06.673340 run osmo-hlr_10.42.42.2(pid=21748): Launched 07:18:06.790710 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:07.330258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21750): Launched 07:18:07.640046 run osmo-stp_10.42.42.5(pid=21751): Launched 07:18:07.756246 run osmo-msc_10.42.42.6: Starting osmo-msc 07:18:08.312133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21753): Launched 07:18:08.623980 run osmo-msc_10.42.42.6(pid=21754): Launched 07:18:08.795796 run osmo-stp_10.42.42.5(pid=21751): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21751)] 07:18:08.924770 run osmo-stp_10.42.42.5(pid=21751): stdout: | (launched: 2022-12-14_07:18:07.583169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:09.054619 run osmo-stp_10.42.42.5(pid=21751): stderr: | 20221214071807750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071807751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071807751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071807751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071807752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071807752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071807752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:09.182603 run osmo-stp_10.42.42.5(pid=21751): stdout: | (launched: 2022-12-14_07:18:07.583169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:09.304279 run osmo-stp_10.42.42.5(pid=21751): stderr: | 20221214071807750 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071807751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071807751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071807751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071807752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071807752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071807752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:09.450373 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21751): Process ended prematurely: osmo-stp_10.42.42.5(pid=21751) [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21751)] [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:18:09.459073 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:18:09.485260 run osmo-hlr_10.42.42.2(pid=21748): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21748)] 07:18:09.532434 run osmo-hlr_10.42.42.2(pid=21748): stdout: | (launched: 2022-12-14_07:18:06.616381) 07:18:09.581616 run osmo-hlr_10.42.42.2(pid=21748): stderr: | 20221214071806789 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071806789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071806789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071806789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071806789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071806789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071806801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071806810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071806810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071806810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:09.650383 run osmo-msc_10.42.42.6(pid=21754): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21754)] 07:18:09.697828 run osmo-msc_10.42.42.6(pid=21754): stdout: | (launched: 2022-12-14_07:18:08.566574) 07:18:09.746891 run osmo-msc_10.42.42.6(pid=21754): stderr: | 20221214071808836 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071808836 DLGLOBAL DEBUG validating counter group 0x7f555909cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071808837 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071808837 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071808837 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071808837 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071808839 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071808839 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071808839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071808839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:18:09.796274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21747): Terminating (SIGTERM) 07:18:09.835736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21750): Terminating (SIGTERM) 07:18:09.875319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21753): Terminating (SIGTERM) 07:18:09.915077 --- ParallelTerminationStrategy: PID 21747 died... 07:18:09.933961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21747): Terminated: ok {rc=0} 07:18:09.978909 --- ParallelTerminationStrategy: PID 21750 died... 07:18:09.997348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21750): Terminated: ok {rc=0} 07:18:10.041158 --- ParallelTerminationStrategy: PID 21753 died... 07:18:10.059693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21753): Terminated: ok {rc=0} 07:18:10.143871 bus /sierra_3: Setting Powered False 07:18:11.242844 bus /sierra_3: Setting Powered False 07:18:12.359156 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:18:13.510214 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:13.522456 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:18:13.594901 tst mo_mt_call_osmux.py: using LAC 39297 07:18:13.727419 tst mo_mt_call_osmux.py: using RAC 27 07:18:13.859394 tst mo_mt_call_osmux.py: using CellId 39297 07:18:13.991611 tst mo_mt_call_osmux.py: using BVCI 39298 07:18:14.115379 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:14.126985 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:14.138401 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:14.149722 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:14.161306 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:18:14.172830 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:18:14.293482 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:18:14.417566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:14.934450 run create_hlr_db(pid=21756): Launched 07:18:15.061329 bus /sierra_2: Setting Powered False 07:18:16.151851 run create_hlr_db(pid=21756): Terminated: ok {rc=0} 07:18:16.598604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21758): Launched 07:18:16.927878 run osmo-hlr_10.42.42.2(pid=21759): Launched 07:18:17.069945 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:17.652840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21761): Launched 07:18:17.963117 run osmo-stp_10.42.42.5(pid=21762): Launched 07:18:18.080499 run osmo-msc_10.42.42.6: Starting osmo-msc 07:18:18.641845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21764): Launched 07:18:18.956817 run osmo-msc_10.42.42.6(pid=21765): Launched 07:18:19.130673 run osmo-stp_10.42.42.5(pid=21762): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21762)] 07:18:19.260499 run osmo-stp_10.42.42.5(pid=21762): stdout: | (launched: 2022-12-14_07:18:17.905852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:19.390331 run osmo-stp_10.42.42.5(pid=21762): stderr: | 20221214071818074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071818074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071818074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071818075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071818075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071818075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071818075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:19.518326 run osmo-stp_10.42.42.5(pid=21762): stdout: | (launched: 2022-12-14_07:18:17.905852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:19.640302 run osmo-stp_10.42.42.5(pid=21762): stderr: | 20221214071818074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071818074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071818074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071818075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071818075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071818075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071818075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:19.786905 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21762): Process ended prematurely: osmo-stp_10.42.42.5(pid=21762) [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21762)] [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:18:19.795677 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:18:19.822150 run osmo-hlr_10.42.42.2(pid=21759): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21759)] 07:18:19.870196 run osmo-hlr_10.42.42.2(pid=21759): stdout: | (launched: 2022-12-14_07:18:16.869648) 07:18:19.919928 run osmo-hlr_10.42.42.2(pid=21759): stderr: | 20221214071817180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071817180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071817180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071817181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071817181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071817181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071817203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071817219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071817220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071817220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:19.989221 run osmo-msc_10.42.42.6(pid=21765): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21765)] 07:18:20.036905 run osmo-msc_10.42.42.6(pid=21765): stdout: | (launched: 2022-12-14_07:18:18.896201) 07:18:20.086515 run osmo-msc_10.42.42.6(pid=21765): stderr: | 20221214071819166 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071819166 DLGLOBAL DEBUG validating counter group 0x7f827d011c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071819167 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071819167 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071819167 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071819167 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071819169 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071819169 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071819169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071819169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:18:20.136365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21758): Terminating (SIGTERM) 07:18:20.176231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21761): Terminating (SIGTERM) 07:18:20.216515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21764): Terminating (SIGTERM) 07:18:20.256688 --- ParallelTerminationStrategy: PID 21758 died... 07:18:20.275837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21758): Terminated: ok {rc=0} 07:18:20.319836 --- ParallelTerminationStrategy: PID 21761 died... 07:18:20.338425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21761): Terminated: ok {rc=0} 07:18:20.382311 --- ParallelTerminationStrategy: PID 21764 died... 07:18:20.401283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21764): Terminated: ok {rc=0} 07:18:20.487738 bus /sierra_3: Setting Powered False 07:18:21.588720 bus /sierra_3: Setting Powered False 07:18:22.705913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 07:18:23.962406 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:18:23.967357 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 07:18:23.999913 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 07:18:24.026540 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 07:18:24.080309 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 07:18:24.114470 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 07:18:24.142442 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 07:18:24.686569 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 07:18:24.735791 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:24.746819 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 07:18:24.796439 tst mo_mt_call.py: using LAC 39298 07:18:24.928696 tst mo_mt_call.py: using RAC 28 07:18:25.060778 tst mo_mt_call.py: using CellId 39298 07:18:25.197160 tst mo_mt_call.py: using BVCI 39299 07:18:25.319703 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:25.331461 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:25.342799 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:25.354289 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:25.365960 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:25.377740 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:18:25.496872 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:18:25.619955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:26.101487 run create_hlr_db(pid=21770): Launched 07:18:26.234224 bus /sierra_2: Setting Powered False 07:18:27.300445 run create_hlr_db(pid=21770): Terminated: ok {rc=0} 07:18:27.744069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21772): Launched 07:18:28.053746 run osmo-hlr_10.42.42.2(pid=21773): Launched 07:18:28.171151 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:28.701555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21775): Launched 07:18:29.013185 run osmo-stp_10.42.42.5(pid=21776): Launched 07:18:29.131028 run osmo-msc_10.42.42.6: Starting osmo-msc 07:18:29.689523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21778): Launched 07:18:30.001051 run osmo-msc_10.42.42.6(pid=21779): Launched 07:18:30.172453 run osmo-stp_10.42.42.5(pid=21776): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21776)] 07:18:30.302331 run osmo-stp_10.42.42.5(pid=21776): stdout: | (launched: 2022-12-14_07:18:28.955684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:30.432343 run osmo-stp_10.42.42.5(pid=21776): stderr: | 20221214071829125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071829125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071829125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071829126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071829126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071829126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071829126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:30.562134 run osmo-stp_10.42.42.5(pid=21776): stdout: | (launched: 2022-12-14_07:18:28.955684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:30.684175 run osmo-stp_10.42.42.5(pid=21776): stderr: | 20221214071829125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071829125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071829125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071829126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071829126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071829126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071829126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:30.830884 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21776): Process ended prematurely: osmo-stp_10.42.42.5(pid=21776) [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21776)] [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 07:18:30.847200 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:18:30.898990 run osmo-hlr_10.42.42.2(pid=21773): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21773)] 07:18:30.963720 run osmo-hlr_10.42.42.2(pid=21773): stdout: | (launched: 2022-12-14_07:18:27.996734) 07:18:31.020360 run osmo-hlr_10.42.42.2(pid=21773): stderr: | 20221214071828171 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071828171 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071828171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071828171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071828171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071828171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071828183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071828192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071828192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071828192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:31.097853 run osmo-msc_10.42.42.6(pid=21779): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21779)] 07:18:31.151419 run osmo-msc_10.42.42.6(pid=21779): stdout: | (launched: 2022-12-14_07:18:29.943436) 07:18:31.206721 run osmo-msc_10.42.42.6(pid=21779): stderr: | 20221214071830214 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071830214 DLGLOBAL DEBUG validating counter group 0x7fe06a730c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071830214 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071830214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071830214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071830214 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071830216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071830217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071830218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071830218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:18:31.265527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21772): Terminating (SIGTERM) 07:18:31.310297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21775): Terminating (SIGTERM) 07:18:31.357939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21778): Terminating (SIGTERM) 07:18:31.405259 --- ParallelTerminationStrategy: PID 21772 died... 07:18:31.428427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21772): Terminated: ok {rc=0} 07:18:31.480165 --- ParallelTerminationStrategy: PID 21775 died... 07:18:31.501598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21775): Terminated: ok {rc=0} 07:18:31.551349 --- ParallelTerminationStrategy: PID 21778 died... 07:18:31.573238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21778): Terminated: ok {rc=0} 07:18:31.668621 bus /sierra_3: Setting Powered False 07:18:32.770414 bus /sierra_3: Setting Powered False 07:18:33.887254 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 07:18:35.035047 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:35.046809 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 07:18:35.101289 tst mo_mt_call_osmux.py: using LAC 39299 07:18:35.231517 tst mo_mt_call_osmux.py: using RAC 29 07:18:35.353109 tst mo_mt_call_osmux.py: using CellId 39299 07:18:35.474295 tst mo_mt_call_osmux.py: using BVCI 39300 07:18:35.587713 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:35.598842 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:35.609786 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:35.620610 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:35.631433 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:18:35.642254 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:18:35.760623 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:18:35.884219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:36.400058 run create_hlr_db(pid=21781): Launched 07:18:36.527871 bus /sierra_2: Setting Powered False 07:18:37.593646 run create_hlr_db(pid=21781): Terminated: ok {rc=0} 07:18:38.036237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21783): Launched 07:18:38.346424 run osmo-hlr_10.42.42.2(pid=21784): Launched 07:18:38.466041 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:38.998225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21786): Launched 07:18:39.308194 run osmo-stp_10.42.42.5(pid=21787): Launched 07:18:39.425858 run osmo-msc_10.42.42.6: Starting osmo-msc 07:18:39.982799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21789): Launched 07:18:40.292695 run osmo-msc_10.42.42.6(pid=21790): Launched 07:18:40.466217 run osmo-stp_10.42.42.5(pid=21787): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21787)] 07:18:40.598041 run osmo-stp_10.42.42.5(pid=21787): stdout: | (launched: 2022-12-14_07:18:39.250725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:40.728339 run osmo-stp_10.42.42.5(pid=21787): stderr: | 20221214071839419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071839419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071839420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071839420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071839421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071839421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071839421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:40.856227 run osmo-stp_10.42.42.5(pid=21787): stdout: | (launched: 2022-12-14_07:18:39.250725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:40.978192 run osmo-stp_10.42.42.5(pid=21787): stderr: | 20221214071839419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071839419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071839420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071839420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071839421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071839421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071839421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:41.124434 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21787): Process ended prematurely: osmo-stp_10.42.42.5(pid=21787) [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21787)] [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 07:18:41.133339 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:18:41.159546 run osmo-hlr_10.42.42.2(pid=21784): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21784)] 07:18:41.207459 run osmo-hlr_10.42.42.2(pid=21784): stdout: | (launched: 2022-12-14_07:18:38.289280) 07:18:41.257230 run osmo-hlr_10.42.42.2(pid=21784): stderr: | 20221214071838462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071838462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071838462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071838463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071838463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071838463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071838475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071838483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071838483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071838483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:41.325914 run osmo-msc_10.42.42.6(pid=21790): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21790)] 07:18:41.373642 run osmo-msc_10.42.42.6(pid=21790): stdout: | (launched: 2022-12-14_07:18:40.235208) 07:18:41.423015 run osmo-msc_10.42.42.6(pid=21790): stderr: | 20221214071840504 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071840505 DLGLOBAL DEBUG validating counter group 0x7f9092682c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071840505 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071840505 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071840505 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071840505 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071840507 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071840507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071840508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071840508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:18:41.472531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21783): Terminating (SIGTERM) 07:18:41.511949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21786): Terminating (SIGTERM) 07:18:41.551587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21789): Terminating (SIGTERM) 07:18:41.591334 --- ParallelTerminationStrategy: PID 21783 died... 07:18:41.610391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21783): Terminated: ok {rc=0} 07:18:41.654232 --- ParallelTerminationStrategy: PID 21786 died... 07:18:41.672788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21786): Terminated: ok {rc=0} 07:18:41.716557 --- ParallelTerminationStrategy: PID 21789 died... 07:18:41.735119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21789): Terminated: ok {rc=0} 07:18:41.820577 bus /sierra_3: Setting Powered False 07:18:42.920631 bus /sierra_3: Setting Powered False 07:18:44.033954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:18:45.285640 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:18:45.292338 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:18:45.326944 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 07:18:45.355508 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 07:18:45.411781 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:18:45.445523 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 07:18:45.472049 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 07:18:46.063740 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 07:18:46.150014 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:46.166466 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:18:46.232569 tst mo_mt_call.py: using LAC 39300 07:18:46.393785 tst mo_mt_call.py: using RAC 30 07:18:46.517649 tst mo_mt_call.py: using CellId 39300 07:18:46.651713 tst mo_mt_call.py: using BVCI 39301 07:18:46.797164 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:46.809273 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:46.821236 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:46.833449 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:46.846070 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:46.858586 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:18:46.982615 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:18:47.131556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:47.638070 run create_hlr_db(pid=21795): Launched 07:18:47.767341 bus /sierra_2: Setting Powered False 07:18:48.828790 run create_hlr_db(pid=21795): Terminated: ok {rc=0} 07:18:49.283486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21797): Launched 07:18:49.618596 run osmo-hlr_10.42.42.2(pid=21798): Launched 07:18:49.746574 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:50.321317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21800): Launched 07:18:50.656080 run osmo-stp_10.42.42.5(pid=21801): Launched 07:18:50.783925 run osmo-msc_10.42.42.6: Starting osmo-msc 07:18:51.383959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21803): Launched 07:18:51.719105 run osmo-msc_10.42.42.6(pid=21804): Launched 07:18:51.903298 run osmo-stp_10.42.42.5(pid=21801): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21801)] 07:18:52.042983 run osmo-stp_10.42.42.5(pid=21801): stdout: | (launched: 2022-12-14_07:18:50.594957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:52.183841 run osmo-stp_10.42.42.5(pid=21801): stderr: | 20221214071850784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071850784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071850784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071850785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071850785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071850785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071850785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:52.321862 run osmo-stp_10.42.42.5(pid=21801): stdout: | (launched: 2022-12-14_07:18:50.594957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:52.453608 run osmo-stp_10.42.42.5(pid=21801): stderr: | 20221214071850784 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071850784 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071850784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071850785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071850785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071850785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071850785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:52.611736 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21801): Process ended prematurely: osmo-stp_10.42.42.5(pid=21801) [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21801)] [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 07:18:52.621441 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 07:18:52.649181 run osmo-hlr_10.42.42.2(pid=21798): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21798)] 07:18:52.699992 run osmo-hlr_10.42.42.2(pid=21798): stdout: | (launched: 2022-12-14_07:18:49.557445) 07:18:52.752173 run osmo-hlr_10.42.42.2(pid=21798): stderr: | 20221214071849752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071849752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071849752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071849752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071849752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071849752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071849765 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071849774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071849774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071849774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:52.824765 run osmo-msc_10.42.42.6(pid=21804): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21804)] 07:18:52.874591 run osmo-msc_10.42.42.6(pid=21804): stdout: | (launched: 2022-12-14_07:18:51.657430) 07:18:52.927049 run osmo-msc_10.42.42.6(pid=21804): stderr: | 20221214071851977 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071851977 DLGLOBAL DEBUG validating counter group 0x7fd2db2dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071851977 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071851977 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071851977 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071851978 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071851979 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071851980 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071851980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071851980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:18:52.979635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21797): Terminating (SIGTERM) 07:18:53.021665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21800): Terminating (SIGTERM) 07:18:53.064138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21803): Terminating (SIGTERM) 07:18:53.106824 --- ParallelTerminationStrategy: PID 21797 died... 07:18:53.127246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21797): Terminated: ok {rc=0} 07:18:53.173887 --- ParallelTerminationStrategy: PID 21800 died... 07:18:53.193656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21800): Terminated: ok {rc=0} 07:18:53.240143 --- ParallelTerminationStrategy: PID 21803 died... 07:18:53.260454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21803): Terminated: ok {rc=0} 07:18:53.349250 bus /sierra_3: Setting Powered False 07:18:54.448351 bus /sierra_3: Setting Powered False 07:18:55.563750 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 07:18:56.712439 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:56.724679 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:18:56.777766 tst mo_mt_call_osmux.py: using LAC 39301 07:18:56.900803 tst mo_mt_call_osmux.py: using RAC 31 07:18:57.024165 tst mo_mt_call_osmux.py: using CellId 39301 07:18:57.147830 tst mo_mt_call_osmux.py: using BVCI 39302 07:18:57.262533 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:57.274021 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:57.285326 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:57.296465 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:57.307741 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:18:57.318931 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:18:57.435949 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:18:57.563202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:58.045053 run create_hlr_db(pid=21806): Launched 07:18:58.170175 bus /sierra_2: Setting Powered False 07:18:59.231048 run create_hlr_db(pid=21806): Terminated: ok {rc=0} 07:18:59.683838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21808): Launched 07:19:00.018929 run osmo-hlr_10.42.42.2(pid=21809): Launched 07:19:00.147295 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:00.721526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21811): Launched 07:19:01.067067 run osmo-stp_10.42.42.5(pid=21812): Launched 07:19:01.270227 run osmo-msc_10.42.42.6: Starting osmo-msc 07:19:01.979904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21814): Launched 07:19:02.353544 run osmo-msc_10.42.42.6(pid=21815): Launched 07:19:02.541721 run osmo-stp_10.42.42.5(pid=21812): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21812)] 07:19:02.682987 run osmo-stp_10.42.42.5(pid=21812): stdout: | (launched: 2022-12-14_07:19:01.007433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:02.826033 run osmo-stp_10.42.42.5(pid=21812): stderr: | 20221214071901366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071901366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071901369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071901370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071901370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071901370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071901370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:02.965195 run osmo-stp_10.42.42.5(pid=21812): stdout: | (launched: 2022-12-14_07:19:01.007433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:03.097481 run osmo-stp_10.42.42.5(pid=21812): stderr: | 20221214071901366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071901366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071901369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071901370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071901370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071901370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071901370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:03.255947 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21812): Process ended prematurely: osmo-stp_10.42.42.5(pid=21812) [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21812)] [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 07:19:03.265610 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 07:19:03.293277 run osmo-hlr_10.42.42.2(pid=21809): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21809)] 07:19:03.343878 run osmo-hlr_10.42.42.2(pid=21809): stdout: | (launched: 2022-12-14_07:18:59.958061) 07:19:03.396176 run osmo-hlr_10.42.42.2(pid=21809): stderr: | 20221214071900152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071900152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071900152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071900152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071900152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071900152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071900165 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071900174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071900174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071900174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:03.468654 run osmo-msc_10.42.42.6(pid=21815): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21815)] 07:19:03.518565 run osmo-msc_10.42.42.6(pid=21815): stdout: | (launched: 2022-12-14_07:19:02.291324) 07:19:03.570704 run osmo-msc_10.42.42.6(pid=21815): stderr: | 20221214071902610 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071902610 DLGLOBAL DEBUG validating counter group 0x7f8e9ce20c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071902611 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071902611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071902611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071902611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071902613 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071902613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071902614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071902614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:19:03.622995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21808): Terminating (SIGTERM) 07:19:03.664791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21811): Terminating (SIGTERM) 07:19:03.706897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21814): Terminating (SIGTERM) 07:19:03.749240 --- ParallelTerminationStrategy: PID 21808 died... 07:19:03.769574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21808): Terminated: ok {rc=0} 07:19:03.815712 --- ParallelTerminationStrategy: PID 21811 died... 07:19:03.835310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21811): Terminated: ok {rc=0} 07:19:03.881298 --- ParallelTerminationStrategy: PID 21814 died... 07:19:03.900893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21814): Terminated: ok {rc=0} 07:19:03.989270 bus /sierra_3: Setting Powered False 07:19:05.088712 bus /sierra_3: Setting Powered False 07:19:06.207502 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 emergency:trx-b200 --------------------------------------------------------------------- 07:19:07.462841 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:19:07.468101 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 07:19:07.502761 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 07:19:07.529436 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 07:19:07.614143 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 07:19:07.646959 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 07:19:07.673430 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 07:19:08.256019 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2401 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 07:19:08.261424 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:08.272119 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 07:19:08.320726 tst emergency_mo_mt_call.py: using LAC 39302 07:19:08.444310 tst emergency_mo_mt_call.py: using RAC 32 07:19:08.562424 tst emergency_mo_mt_call.py: using CellId 39302 07:19:08.682259 tst emergency_mo_mt_call.py: using BVCI 39303 07:19:08.794458 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:08.805489 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:08.816072 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:08.826622 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:08.837222 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:08.847690 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:19:08.969554 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:19:09.086905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:09.556735 run create_hlr_db(pid=21820): Launched 07:19:09.679240 bus /sierra_2: Setting Powered False 07:19:10.740237 run create_hlr_db(pid=21820): Terminated: ok {rc=0} 07:19:11.186778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21822): Launched 07:19:11.513356 run osmo-hlr_10.42.42.2(pid=21823): Launched 07:19:11.639489 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:12.206119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21825): Launched 07:19:12.532583 run osmo-stp_10.42.42.5(pid=21826): Launched 07:19:12.666424 tst emergency_mo_mt_call.py: using MSISDN 8564 07:19:12.833571 run osmo-msc_10.42.42.6: Starting osmo-msc 07:19:13.419229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21828): Launched 07:19:13.745746 run osmo-msc_10.42.42.6(pid=21829): Launched 07:19:13.929493 run osmo-stp_10.42.42.5(pid=21826): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21826)] 07:19:14.068392 run osmo-stp_10.42.42.5(pid=21826): stdout: | (launched: 2022-12-14_07:19:12.472457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:14.207717 run osmo-stp_10.42.42.5(pid=21826): stderr: | 20221214071912664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071912664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071912665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071912665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071912666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071912666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071912666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:14.344586 run osmo-stp_10.42.42.5(pid=21826): stdout: | (launched: 2022-12-14_07:19:12.472457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:14.475061 run osmo-stp_10.42.42.5(pid=21826): stderr: | 20221214071912664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071912664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071912665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071912665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071912666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071912666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071912666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:14.631021 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=21826): Process ended prematurely: osmo-stp_10.42.42.5(pid=21826) [trial-2401↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21826)] [trial-2401↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 07:19:14.639903 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 07:19:14.667221 run osmo-hlr_10.42.42.2(pid=21823): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21823)] 07:19:14.717968 run osmo-hlr_10.42.42.2(pid=21823): stdout: | (launched: 2022-12-14_07:19:11.453554) 07:19:14.769876 run osmo-hlr_10.42.42.2(pid=21823): stderr: | 20221214071911648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071911648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071911648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071911648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071911648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071911648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071911662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071911671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071911671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071911671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:14.842584 run osmo-msc_10.42.42.6(pid=21829): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21829)] 07:19:14.892373 run osmo-msc_10.42.42.6(pid=21829): stdout: | (launched: 2022-12-14_07:19:13.685841) 07:19:14.944573 run osmo-msc_10.42.42.6(pid=21829): stderr: | 20221214071914003 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071914003 DLGLOBAL DEBUG validating counter group 0x7f83696e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071914004 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071914004 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071914004 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071914004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071914006 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071914006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071914006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071914006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:19:14.996783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21822): Terminating (SIGTERM) 07:19:15.038449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21825): Terminating (SIGTERM) 07:19:15.081518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21828): Terminating (SIGTERM) 07:19:15.124022 --- ParallelTerminationStrategy: PID 21822 died... 07:19:15.144515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21822): Terminated: ok {rc=0} 07:19:15.191127 --- ParallelTerminationStrategy: PID 21825 died... 07:19:15.211038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21825): Terminated: ok {rc=0} 07:19:15.257424 --- ParallelTerminationStrategy: PID 21828 died... 07:19:15.277328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21828): Terminated: ok {rc=0} 07:19:15.366026 bus /sierra_3: Setting Powered False 07:19:16.465231 bus /sierra_3: Setting Powered False 07:19:17.591677 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 07:19:18.679235 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:18.691249 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 07:19:18.743927 tst emergency_preemptive_call.py: using LAC 39303 07:19:18.871542 tst emergency_preemptive_call.py: using RAC 33 07:19:18.991827 tst emergency_preemptive_call.py: using CellId 39303 07:19:19.122369 tst emergency_preemptive_call.py: using BVCI 39304 07:19:19.240425 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:19.251803 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:19.262910 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:19.274033 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:19.285421 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:19:19.296697 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:19:19.415435 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:19:19.538418 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:19:19.661295 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:19:19.779349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:20.252390 run create_hlr_db(pid=21831): Launched 07:19:20.379915 bus /sierra_2: Setting Powered False 07:19:21.444920 run create_hlr_db(pid=21831): Terminated: ok {rc=0} 07:19:21.883415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21833): Launched 07:19:22.189431 run osmo-hlr_10.42.42.2(pid=21834): Launched 07:19:22.304789 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:22.840755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21836): Launched 07:19:23.168306 run osmo-stp_10.42.42.5(pid=21837): Launched 07:19:23.302704 tst emergency_preemptive_call.py: using MSISDN 8565 07:19:23.475108 run osmo-msc_10.42.42.6: Starting osmo-msc 07:19:24.062333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21839): Launched 07:19:24.388925 run osmo-msc_10.42.42.6(pid=21840): Launched 07:19:24.570704 run osmo-stp_10.42.42.5(pid=21837): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21837)] 07:19:24.707687 run osmo-stp_10.42.42.5(pid=21837): stdout: | (launched: 2022-12-14_07:19:23.108071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:24.845400 run osmo-stp_10.42.42.5(pid=21837): stderr: | 20221214071923298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071923299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071923299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071923299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071923300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071923300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071923300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:24.981493 run osmo-stp_10.42.42.5(pid=21837): stdout: | (launched: 2022-12-14_07:19:23.108071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:25.111117 run osmo-stp_10.42.42.5(pid=21837): stderr: | 20221214071923298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071923299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071923299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071923299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071923300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071923300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071923300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:25.265985 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=21837): Process ended prematurely: osmo-stp_10.42.42.5(pid=21837) [trial-2401↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21837)] [trial-2401↪emergency:trx-b200↪emergency_preemptive_call.py:32] 07:19:25.274960 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 07:19:25.302572 run osmo-hlr_10.42.42.2(pid=21834): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21834)] 07:19:25.353700 run osmo-hlr_10.42.42.2(pid=21834): stdout: | (launched: 2022-12-14_07:19:22.132664) 07:19:25.406496 run osmo-hlr_10.42.42.2(pid=21834): stderr: | 20221214071922306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071922306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071922306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071922306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071922306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071922306 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071922318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071922327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071922327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071922327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:25.479748 run osmo-msc_10.42.42.6(pid=21840): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=21840)] 07:19:25.530189 run osmo-msc_10.42.42.6(pid=21840): stdout: | (launched: 2022-12-14_07:19:24.328765) 07:19:25.582880 run osmo-msc_10.42.42.6(pid=21840): stderr: | 20221214071924648 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214071924649 DLGLOBAL DEBUG validating counter group 0x7f6d76786c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214071924649 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214071924649 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214071924649 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214071924649 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214071924651 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214071924651 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214071924652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214071924652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:19:25.635625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21833): Terminating (SIGTERM) 07:19:25.677958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21836): Terminating (SIGTERM) 07:19:25.721082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21839): Terminating (SIGTERM) 07:19:25.763834 --- ParallelTerminationStrategy: PID 21833 died... 07:19:25.784350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21833): Terminated: ok {rc=0} 07:19:25.831110 --- ParallelTerminationStrategy: PID 21836 died... 07:19:25.850979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21836): Terminated: ok {rc=0} 07:19:25.897554 --- ParallelTerminationStrategy: PID 21839 died... 07:19:25.917462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21839): Terminated: ok {rc=0} 07:19:26.005656 bus /sierra_9: Setting Powered False 07:19:27.104871 bus /sierra_9: Setting Powered False 07:19:28.222407 bus /sierra_8: Setting Powered False 07:19:29.322061 bus /sierra_8: Setting Powered False 07:19:30.438462 bus /sierra_3: Setting Powered False 07:19:31.540095 bus /sierra_3: Setting Powered False 07:19:32.655544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-b200 --------------------------------------------------------------------- 07:19:33.939611 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:19:33.944809 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 07:19:33.978968 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 07:19:34.018978 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 07:19:34.111636 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 07:19:34.144485 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 07:19:34.182564 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 07:19:34.773243 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 07:19:34.828532 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:34.839891 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:19:34.892258 tst cs_paging_gprs_active.py: using LAC 39304 07:19:35.024041 tst cs_paging_gprs_active.py: using RAC 34 07:19:35.154934 tst cs_paging_gprs_active.py: using CellId 39304 07:19:35.286879 tst cs_paging_gprs_active.py: using BVCI 39305 07:19:35.403254 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:35.414155 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:35.424821 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:35.435569 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:35.446669 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:35.457249 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:35.469546 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:35.480632 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:35.491952 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:19:35.614867 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:19:35.739071 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:19:35.965098 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:36.300220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21845): Launched 07:19:36.592468 run iperf3-srv_10.42.42.10(pid=21846): Launched 07:19:36.718991 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:19:36.944394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:37.280180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21847): Launched 07:19:37.572545 run iperf3-srv_10.42.42.10(pid=21848): Launched 07:19:37.697985 tst cs_paging_gprs_active.py:38: start network... 07:19:37.923206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:38.438812 run create_hlr_db(pid=21849): Launched 07:19:38.567427 bus /sierra_2: Setting Powered False 07:19:39.632676 run create_hlr_db(pid=21849): Terminated: ok {rc=0} 07:19:40.075421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21851): Launched 07:19:40.386350 run osmo-hlr_10.42.42.2(pid=21852): Launched 07:19:40.503861 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:41.037389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21854): Launched 07:19:41.349557 run osmo-stp_10.42.42.5(pid=21855): Launched 07:19:41.467558 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:42.007919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21857): Launched 07:19:42.128545 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:42.391230 run patchelf(pid=21858): Launched 07:19:42.564116 run osmo-stp_10.42.42.5(pid=21855): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21855)] 07:19:42.695752 run osmo-stp_10.42.42.5(pid=21855): stdout: | (launched: 2022-12-14_07:19:41.291490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:42.828114 run osmo-stp_10.42.42.5(pid=21855): stderr: | 20221214071941463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071941464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071941464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071941464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071941465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071941465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071941465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:42.960284 run osmo-stp_10.42.42.5(pid=21855): stdout: | (launched: 2022-12-14_07:19:41.291490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:43.087974 run osmo-stp_10.42.42.5(pid=21855): stderr: | 20221214071941463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071941464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071941464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071941464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071941465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071941465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071941465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:43.237933 run patchelf(pid=21858): Terminating (SIGINT) 07:19:43.413453 run patchelf(pid=21858): Terminated: ok {rc=0} 07:19:43.540336 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21855): Process ended prematurely: osmo-stp_10.42.42.5(pid=21855) [trial-2401↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21855)] [trial-2401↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 07:19:43.549977 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:19:43.576755 run osmo-hlr_10.42.42.2(pid=21852): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21852)] 07:19:43.624392 run osmo-hlr_10.42.42.2(pid=21852): stdout: | (launched: 2022-12-14_07:19:40.328765) 07:19:43.673677 run osmo-hlr_10.42.42.2(pid=21852): stderr: | 20221214071940502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071940502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071940502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071940502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071940502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071940502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071940514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071940522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071940522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071940522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:43.723280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21845): Terminating (SIGTERM) 07:19:43.763132 run iperf3-srv_10.42.42.10(pid=21846): Terminating (SIGTERM) 07:19:43.803097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21847): Terminating (SIGTERM) 07:19:43.843063 run iperf3-srv_10.42.42.10(pid=21848): Terminating (SIGTERM) 07:19:43.882670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21851): Terminating (SIGTERM) 07:19:43.922607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21854): Terminating (SIGTERM) 07:19:43.962358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21857): Terminating (SIGTERM) 07:19:44.002322 --- ParallelTerminationStrategy: PID 21845 died... 07:19:44.021407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21845): Terminated: ok {rc=0} 07:19:44.065399 --- ParallelTerminationStrategy: PID 21846 died... 07:19:44.083795 run iperf3-srv_10.42.42.10(pid=21846): Terminated {rc=256} 07:19:44.127439 --- ParallelTerminationStrategy: PID 21847 died... 07:19:44.145943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21847): Terminated: ok {rc=0} 07:19:44.189463 --- ParallelTerminationStrategy: PID 21848 died... 07:19:44.207984 run iperf3-srv_10.42.42.10(pid=21848): Terminated {rc=256} 07:19:44.251524 --- ParallelTerminationStrategy: PID 21851 died... 07:19:44.270108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21851): Terminated: ok {rc=0} 07:19:44.313856 --- ParallelTerminationStrategy: PID 21854 died... 07:19:44.332376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21854): Terminated: ok {rc=0} 07:19:44.376516 --- ParallelTerminationStrategy: PID 21857 died... 07:19:44.395153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21857): Terminated: ok {rc=0} 07:19:44.480711 bus /gobi_0: Setting Powered False 07:19:45.581773 bus /gobi_0: Setting Powered False 07:19:46.695046 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200 iperf3.py ---------------------------------------------- 07:19:47.838887 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:47.850250 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:19:47.903629 tst iperf3.py: using LAC 39305 07:19:48.036470 tst iperf3.py: using RAC 35 07:19:48.167966 tst iperf3.py: using CellId 39305 07:19:48.297442 tst iperf3.py: using BVCI 39306 07:19:48.412159 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:48.423241 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:48.433998 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:48.444637 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:48.455081 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:48.465526 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:48.476112 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:48.486542 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:48.497715 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:19:48.620211 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:19:48.830439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:49.143727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21859): Launched 07:19:49.416130 run iperf3-srv_10.42.42.10(pid=21860): Launched 07:19:49.531878 tst iperf3.py:8: start network... 07:19:49.738866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:50.216203 run create_hlr_db(pid=21861): Launched 07:19:50.342436 bus /gobi_6: Setting Powered False 07:19:51.402434 run create_hlr_db(pid=21861): Terminated: ok {rc=0} 07:19:51.833618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21863): Launched 07:19:52.145885 run osmo-hlr_10.42.42.2(pid=21864): Launched 07:19:52.264669 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:52.797377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21866): Launched 07:19:53.111059 run osmo-stp_10.42.42.5(pid=21867): Launched 07:19:53.229646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:53.762043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21869): Launched 07:19:53.881052 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:54.142134 run patchelf(pid=21870): Launched 07:19:54.314322 run osmo-stp_10.42.42.5(pid=21867): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21867)] 07:19:54.444730 run osmo-stp_10.42.42.5(pid=21867): stdout: | (launched: 2022-12-14_07:19:53.052179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:54.576765 run osmo-stp_10.42.42.5(pid=21867): stderr: | 20221214071953223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071953223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071953224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071953224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071953225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071953225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071953225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:54.709240 run osmo-stp_10.42.42.5(pid=21867): stdout: | (launched: 2022-12-14_07:19:53.052179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:54.834926 run osmo-stp_10.42.42.5(pid=21867): stderr: | 20221214071953223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214071953223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214071953224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214071953224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214071953225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214071953225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214071953225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:54.983925 run patchelf(pid=21870): Terminating (SIGINT) 07:19:55.159750 run patchelf(pid=21870): Terminated: ok {rc=0} 07:19:55.286246 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21867): Process ended prematurely: osmo-stp_10.42.42.5(pid=21867) [trial-2401↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21867)] [trial-2401↪gprs:trx-b200↪iperf3.py:8] 07:19:55.295762 tst iperf3.py:8: Test FAILED (7.5 sec) 07:19:55.322521 run osmo-hlr_10.42.42.2(pid=21864): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21864)] 07:19:55.369740 run osmo-hlr_10.42.42.2(pid=21864): stdout: | (launched: 2022-12-14_07:19:52.088031) 07:19:55.418507 run osmo-hlr_10.42.42.2(pid=21864): stderr: | 20221214071952262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214071952262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214071952262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214071952262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214071952262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214071952262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214071952275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214071952283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214071952283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214071952283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:55.467809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21859): Terminating (SIGTERM) 07:19:55.507755 run iperf3-srv_10.42.42.10(pid=21860): Terminating (SIGTERM) 07:19:55.547243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21863): Terminating (SIGTERM) 07:19:55.587011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21866): Terminating (SIGTERM) 07:19:55.626757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21869): Terminating (SIGTERM) 07:19:55.666848 --- ParallelTerminationStrategy: PID 21859 died... 07:19:55.686210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21859): Terminated: ok {rc=0} 07:19:55.730109 --- ParallelTerminationStrategy: PID 21860 died... 07:19:55.748454 run iperf3-srv_10.42.42.10(pid=21860): Terminated {rc=256} 07:19:55.792293 --- ParallelTerminationStrategy: PID 21863 died... 07:19:55.811020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21863): Terminated: ok {rc=0} 07:19:55.854826 --- ParallelTerminationStrategy: PID 21866 died... 07:19:55.873511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21866): Terminated: ok {rc=0} 07:19:55.917302 --- ParallelTerminationStrategy: PID 21869 died... 07:19:55.936090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21869): Terminated: ok {rc=0} 07:19:56.022981 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 07:19:57.171610 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:57.183077 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:19:57.232214 tst iperf3m4.py: using LAC 39306 07:19:57.367537 tst iperf3m4.py: using RAC 36 07:19:57.497266 tst iperf3m4.py: using CellId 39306 07:19:57.625370 tst iperf3m4.py: using BVCI 39307 07:19:57.746173 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:57.757795 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:57.769017 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:57.780021 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:57.791248 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:57.803042 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:57.814823 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:57.826365 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:19:57.838040 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:19:57.957416 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:19:58.080736 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:19:58.203599 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:19:58.321713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:19:58.531356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:58.845382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21871): Launched 07:19:59.119584 run iperf3-srv_10.42.42.10(pid=21872): Launched 07:19:59.237439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:19:59.445612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:59.758273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21873): Launched 07:20:00.031374 run iperf3-srv_10.42.42.10(pid=21874): Launched 07:20:00.150054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:20:00.358276 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:00.670903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21875): Launched 07:20:00.963620 run iperf3-srv_10.42.42.10(pid=21876): Launched 07:20:01.113865 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:20:01.327390 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:01.665870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21880): Launched 07:20:01.955155 run iperf3-srv_10.42.42.10(pid=21881): Launched 07:20:02.128692 tst iperf3m4.py:8: start network... 07:20:02.366740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:02.885790 run create_hlr_db(pid=21882): Launched 07:20:03.015553 bus /gobi_6: Setting Powered False 07:20:04.081427 run create_hlr_db(pid=21882): Terminated: ok {rc=0} 07:20:04.525423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21884): Launched 07:20:04.839292 run osmo-hlr_10.42.42.2(pid=21885): Launched 07:20:04.956819 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:05.508023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21887): Launched 07:20:05.819833 run osmo-stp_10.42.42.5(pid=21888): Launched 07:20:05.949258 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:06.523530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21890): Launched 07:20:06.651816 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:06.933711 run patchelf(pid=21891): Launched 07:20:07.121989 run osmo-stp_10.42.42.5(pid=21888): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21888)] 07:20:07.264479 run osmo-stp_10.42.42.5(pid=21888): stdout: | (launched: 2022-12-14_07:20:05.761832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:07.408318 run osmo-stp_10.42.42.5(pid=21888): stderr: | 20221214072005944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072005945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072005945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072005945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072005946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072005946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072005946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:07.551746 run osmo-stp_10.42.42.5(pid=21888): stdout: | (launched: 2022-12-14_07:20:05.761832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:07.689201 run osmo-stp_10.42.42.5(pid=21888): stderr: | 20221214072005944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072005945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072005945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072005945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072005946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072005946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072005946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:07.851622 run patchelf(pid=21891): Terminating (SIGINT) 07:20:08.040768 run patchelf(pid=21891): Terminated: ok {rc=0} 07:20:08.178531 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21888): Process ended prematurely: osmo-stp_10.42.42.5(pid=21888) [trial-2401↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21888)] [trial-2401↪gprs:trx-b200↪iperf3m4.py:8] 07:20:08.188841 tst iperf3m4.py:8: Test FAILED (11.1 sec) 07:20:08.217884 run osmo-hlr_10.42.42.2(pid=21885): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21885)] 07:20:08.269225 run osmo-hlr_10.42.42.2(pid=21885): stdout: | (launched: 2022-12-14_07:20:04.781351) 07:20:08.322096 run osmo-hlr_10.42.42.2(pid=21885): stderr: | 20221214072004953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072004953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072004953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072004954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072004954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072004954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072004968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072004977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072004977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072004977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:08.375321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21871): Terminating (SIGTERM) 07:20:08.418085 run iperf3-srv_10.42.42.10(pid=21872): Terminating (SIGTERM) 07:20:08.460826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21873): Terminating (SIGTERM) 07:20:08.503659 run iperf3-srv_10.42.42.10(pid=21874): Terminating (SIGTERM) 07:20:08.546537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21875): Terminating (SIGTERM) 07:20:08.589732 run iperf3-srv_10.42.42.10(pid=21876): Terminating (SIGTERM) 07:20:08.632479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21880): Terminating (SIGTERM) 07:20:08.675243 run iperf3-srv_10.42.42.10(pid=21881): Terminating (SIGTERM) 07:20:08.717644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21884): Terminating (SIGTERM) 07:20:08.760365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21887): Terminating (SIGTERM) 07:20:08.802918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21890): Terminating (SIGTERM) 07:20:08.846116 --- ParallelTerminationStrategy: PID 21871 died... 07:20:08.866862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21871): Terminated: ok {rc=0} 07:20:08.913880 --- ParallelTerminationStrategy: PID 21872 died... 07:20:08.933932 run iperf3-srv_10.42.42.10(pid=21872): Terminated {rc=256} 07:20:08.980560 --- ParallelTerminationStrategy: PID 21873 died... 07:20:09.000676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21873): Terminated: ok {rc=0} 07:20:09.047522 --- ParallelTerminationStrategy: PID 21874 died... 07:20:09.067569 run iperf3-srv_10.42.42.10(pid=21874): Terminated {rc=256} 07:20:09.114872 --- ParallelTerminationStrategy: PID 21875 died... 07:20:09.135093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21875): Terminated: ok {rc=0} 07:20:09.181571 --- ParallelTerminationStrategy: PID 21876 died... 07:20:09.201621 run iperf3-srv_10.42.42.10(pid=21876): Terminated {rc=256} 07:20:09.248308 --- ParallelTerminationStrategy: PID 21880 died... 07:20:09.268488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21880): Terminated: ok {rc=0} 07:20:09.315313 --- ParallelTerminationStrategy: PID 21881 died... 07:20:09.335187 run iperf3-srv_10.42.42.10(pid=21881): Terminated {rc=256} 07:20:09.382103 --- ParallelTerminationStrategy: PID 21884 died... 07:20:09.402136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21884): Terminated: ok {rc=0} 07:20:09.448624 --- ParallelTerminationStrategy: PID 21887 died... 07:20:09.468740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21887): Terminated: ok {rc=0} 07:20:09.515196 --- ParallelTerminationStrategy: PID 21890 died... 07:20:09.535252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21890): Terminated: ok {rc=0} 07:20:09.624356 bus /gobi_4: Setting Powered False 07:20:10.723926 bus /gobi_4: Setting Powered False 07:20:11.840706 bus /gobi_1: Setting Powered False 07:20:12.939310 bus /gobi_1: Setting Powered False 07:20:14.057965 bus /gobi_0: Setting Powered False 07:20:15.156733 bus /gobi_0: Setting Powered False 07:20:16.268928 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200 ping.py ---------------------------------------------- 07:20:17.371196 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:17.383273 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:20:17.434257 tst ping.py: using LAC 39307 07:20:17.562520 tst ping.py: using RAC 37 07:20:17.692199 tst ping.py: using CellId 39307 07:20:17.821928 tst ping.py: using BVCI 39308 07:20:17.943337 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:17.954615 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:17.965693 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:17.976503 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:17.987773 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:17.999268 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:18.010677 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:18.021987 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:20:18.139948 tst ping.py:19: start network... 07:20:18.345387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:18.816939 run create_hlr_db(pid=21892): Launched 07:20:18.941969 bus /gobi_6: Setting Powered False 07:20:20.001960 run create_hlr_db(pid=21892): Terminated: ok {rc=0} 07:20:20.448551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21894): Launched 07:20:20.776261 run osmo-hlr_10.42.42.2(pid=21895): Launched 07:20:20.900638 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:21.472203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21897): Launched 07:20:21.799910 run osmo-stp_10.42.42.5(pid=21898): Launched 07:20:21.925730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:22.488669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21900): Launched 07:20:22.615635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:22.891846 run patchelf(pid=21901): Launched 07:20:23.074803 run osmo-stp_10.42.42.5(pid=21898): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21898)] 07:20:23.214027 run osmo-stp_10.42.42.5(pid=21898): stdout: | (launched: 2022-12-14_07:20:21.739567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:23.354140 run osmo-stp_10.42.42.5(pid=21898): stderr: | 20221214072021929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072021929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072021929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072021930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072021930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072021930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072021931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:23.494454 run osmo-stp_10.42.42.5(pid=21898): stdout: | (launched: 2022-12-14_07:20:21.739567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:23.627864 run osmo-stp_10.42.42.5(pid=21898): stderr: | 20221214072021929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072021929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072021929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072021930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072021930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072021930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072021931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:23.785908 run patchelf(pid=21901): Terminating (SIGINT) 07:20:23.970189 run patchelf(pid=21901): Terminated: ok {rc=0} 07:20:24.103457 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21898): Process ended prematurely: osmo-stp_10.42.42.5(pid=21898) [trial-2401↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21898)] [trial-2401↪gprs:trx-b200↪ping.py:22] 07:20:24.113109 tst ping.py:22: Test FAILED (6.7 sec) 07:20:24.141501 run osmo-hlr_10.42.42.2(pid=21895): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21895)] 07:20:24.192320 run osmo-hlr_10.42.42.2(pid=21895): stdout: | (launched: 2022-12-14_07:20:20.716055) 07:20:24.245175 run osmo-hlr_10.42.42.2(pid=21895): stderr: | 20221214072020911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072020911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072020911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072020911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072020911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072020911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072020923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072020932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072020933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072020933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:24.298022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21894): Terminating (SIGTERM) 07:20:24.340075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21897): Terminating (SIGTERM) 07:20:24.382639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21900): Terminating (SIGTERM) 07:20:24.425435 --- ParallelTerminationStrategy: PID 21894 died... 07:20:24.446166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21894): Terminated: ok {rc=0} 07:20:24.493133 --- ParallelTerminationStrategy: PID 21897 died... 07:20:24.513358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21897): Terminated: ok {rc=0} 07:20:24.560092 --- ParallelTerminationStrategy: PID 21900 died... 07:20:24.580281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21900): Terminated: ok {rc=0} 07:20:24.669102 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 07:20:25.757748 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:25.769871 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:20:25.821439 tst ping_idle_ping.py: using LAC 39308 07:20:25.950850 tst ping_idle_ping.py: using RAC 38 07:20:26.080647 tst ping_idle_ping.py: using CellId 39308 07:20:26.214539 tst ping_idle_ping.py: using BVCI 39309 07:20:26.335940 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:26.347132 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:26.358266 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:26.369306 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:26.380469 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:26.392119 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:26.403457 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:20:26.414978 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:20:26.535078 tst ping_idle_ping.py:24: start network... 07:20:26.740829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:27.216478 run create_hlr_db(pid=21902): Launched 07:20:27.343009 bus /gobi_6: Setting Powered False 07:20:28.403334 run create_hlr_db(pid=21902): Terminated: ok {rc=0} 07:20:28.851183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21904): Launched 07:20:29.181215 run osmo-hlr_10.42.42.2(pid=21905): Launched 07:20:29.305324 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:29.874568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21907): Launched 07:20:30.201921 run osmo-stp_10.42.42.5(pid=21908): Launched 07:20:30.327246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:30.921053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21910): Launched 07:20:31.054152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:31.341711 run patchelf(pid=21911): Launched 07:20:31.528621 run osmo-stp_10.42.42.5(pid=21908): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21908)] 07:20:31.662897 run osmo-stp_10.42.42.5(pid=21908): stdout: | (launched: 2022-12-14_07:20:30.141713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:31.796592 run osmo-stp_10.42.42.5(pid=21908): stderr: | 20221214072030331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072030332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072030332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072030332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072030333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072030333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072030333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:31.930768 run osmo-stp_10.42.42.5(pid=21908): stdout: | (launched: 2022-12-14_07:20:30.141713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:32.059257 run osmo-stp_10.42.42.5(pid=21908): stderr: | 20221214072030331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072030332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072030332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072030332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072030333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072030333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072030333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:32.208815 run patchelf(pid=21911): Terminating (SIGINT) 07:20:32.382021 run patchelf(pid=21911): Terminated: ok {rc=0} 07:20:32.506632 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21908): Process ended prematurely: osmo-stp_10.42.42.5(pid=21908) [trial-2401↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21908)] [trial-2401↪gprs:trx-b200↪ping_idle_ping.py:27] 07:20:32.515646 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:20:32.542524 run osmo-hlr_10.42.42.2(pid=21905): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21905)] 07:20:32.590058 run osmo-hlr_10.42.42.2(pid=21905): stdout: | (launched: 2022-12-14_07:20:29.120625) 07:20:32.639468 run osmo-hlr_10.42.42.2(pid=21905): stderr: | 20221214072029315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072029315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072029315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072029315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072029315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072029315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072029326 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072029336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072029337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072029337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:32.689367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21904): Terminating (SIGTERM) 07:20:32.729210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21907): Terminating (SIGTERM) 07:20:32.769310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21910): Terminating (SIGTERM) 07:20:32.810009 --- ParallelTerminationStrategy: PID 21904 died... 07:20:32.829425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21904): Terminated: ok {rc=0} 07:20:32.873768 --- ParallelTerminationStrategy: PID 21907 died... 07:20:32.892310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21907): Terminated: ok {rc=0} 07:20:32.936819 --- ParallelTerminationStrategy: PID 21910 died... 07:20:32.955990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21910): Terminated: ok {rc=0} 07:20:33.040547 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 07:20:34.353669 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:20:34.359961 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:20:34.392837 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:20:34.431431 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:20:34.518831 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:20:34.551017 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:20:34.588402 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:20:35.180664 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:20:35.230542 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:35.241516 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:20:35.291817 tst cs_paging_gprs_active.py: using LAC 39309 07:20:35.415636 tst cs_paging_gprs_active.py: using RAC 39 07:20:35.539898 tst cs_paging_gprs_active.py: using CellId 39309 07:20:35.664162 tst cs_paging_gprs_active.py: using BVCI 39310 07:20:35.779436 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:35.790720 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:35.801388 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:35.811967 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:35.822614 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:35.833166 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:35.844352 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:35.854906 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:35.865643 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:20:35.988882 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:20:36.107431 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:20:36.317928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:36.631174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21918): Launched 07:20:36.901649 run iperf3-srv_10.42.42.10(pid=21919): Launched 07:20:37.018609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:20:37.228574 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:37.543646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21920): Launched 07:20:37.814234 run iperf3-srv_10.42.42.10(pid=21921): Launched 07:20:37.932314 tst cs_paging_gprs_active.py:38: start network... 07:20:38.140434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:38.621104 run create_hlr_db(pid=21922): Launched 07:20:38.747176 bus /gobi_6: Setting Powered False 07:20:39.807985 run create_hlr_db(pid=21922): Terminated: ok {rc=0} 07:20:40.262044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21924): Launched 07:20:40.595800 run osmo-hlr_10.42.42.2(pid=21925): Launched 07:20:40.724489 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:41.301427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21927): Launched 07:20:41.637205 run osmo-stp_10.42.42.5(pid=21928): Launched 07:20:41.764181 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:42.348102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21930): Launched 07:20:42.477804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:42.759855 run patchelf(pid=21931): Launched 07:20:42.947026 run osmo-stp_10.42.42.5(pid=21928): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21928)] 07:20:43.088382 run osmo-stp_10.42.42.5(pid=21928): stdout: | (launched: 2022-12-14_07:20:41.575293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:43.231281 run osmo-stp_10.42.42.5(pid=21928): stderr: | 20221214072041765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072041765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072041765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072041766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072041766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072041766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072041766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:43.373614 run osmo-stp_10.42.42.5(pid=21928): stdout: | (launched: 2022-12-14_07:20:41.575293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:43.510063 run osmo-stp_10.42.42.5(pid=21928): stderr: | 20221214072041765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072041765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072041765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072041766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072041766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072041766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072041766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:43.672130 run patchelf(pid=21931): Terminating (SIGINT) 07:20:43.860755 run patchelf(pid=21931): Terminated: ok {rc=0} 07:20:43.996687 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21928): Process ended prematurely: osmo-stp_10.42.42.5(pid=21928) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21928)] [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:20:44.007018 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:20:44.035549 run osmo-hlr_10.42.42.2(pid=21925): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21925)] 07:20:44.086392 run osmo-hlr_10.42.42.2(pid=21925): stdout: | (launched: 2022-12-14_07:20:40.534586) 07:20:44.139226 run osmo-hlr_10.42.42.2(pid=21925): stderr: | 20221214072040730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072040730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072040730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072040730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072040730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072040730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072040743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072040753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072040754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072040754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:44.192265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21918): Terminating (SIGTERM) 07:20:44.234426 run iperf3-srv_10.42.42.10(pid=21919): Terminating (SIGTERM) 07:20:44.276702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21920): Terminating (SIGTERM) 07:20:44.319143 run iperf3-srv_10.42.42.10(pid=21921): Terminating (SIGTERM) 07:20:44.361347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21924): Terminating (SIGTERM) 07:20:44.403554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21927): Terminating (SIGTERM) 07:20:44.445948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21930): Terminating (SIGTERM) 07:20:44.488292 --- ParallelTerminationStrategy: PID 21918 died... 07:20:44.508689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21918): Terminated: ok {rc=0} 07:20:44.555072 --- ParallelTerminationStrategy: PID 21919 died... 07:20:44.574773 run iperf3-srv_10.42.42.10(pid=21919): Terminated {rc=256} 07:20:44.620648 --- ParallelTerminationStrategy: PID 21920 died... 07:20:44.640281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21920): Terminated: ok {rc=0} 07:20:44.686295 --- ParallelTerminationStrategy: PID 21921 died... 07:20:44.705969 run iperf3-srv_10.42.42.10(pid=21921): Terminated {rc=256} 07:20:44.751831 --- ParallelTerminationStrategy: PID 21924 died... 07:20:44.771596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21924): Terminated: ok {rc=0} 07:20:44.817739 --- ParallelTerminationStrategy: PID 21927 died... 07:20:44.837783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21927): Terminated: ok {rc=0} 07:20:44.883651 --- ParallelTerminationStrategy: PID 21930 died... 07:20:44.903326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21930): Terminated: ok {rc=0} 07:20:44.991247 bus /gobi_0: Setting Powered False 07:20:46.109772 bus /gobi_0: Setting Powered False 07:20:47.244103 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:20:48.390612 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:48.402185 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:20:48.455147 tst iperf3.py: using LAC 39310 07:20:48.578293 tst iperf3.py: using RAC 40 07:20:48.701308 tst iperf3.py: using CellId 39310 07:20:48.822378 tst iperf3.py: using BVCI 39311 07:20:48.937259 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:48.948135 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:48.958807 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:48.969475 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:48.980048 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:48.990674 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:49.001489 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:49.011987 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:49.022754 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:20:49.140322 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:20:49.349770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:49.662375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21932): Launched 07:20:49.935886 run iperf3-srv_10.42.42.10(pid=21933): Launched 07:20:50.051716 tst iperf3.py:8: start network... 07:20:50.259621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:50.738789 run create_hlr_db(pid=21934): Launched 07:20:50.867524 bus /gobi_6: Setting Powered False 07:20:51.929182 run create_hlr_db(pid=21934): Terminated: ok {rc=0} 07:20:52.385745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21938): Launched 07:20:52.721981 run osmo-hlr_10.42.42.2(pid=21939): Launched 07:20:52.849699 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:53.421215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21941): Launched 07:20:53.754606 run osmo-stp_10.42.42.5(pid=21942): Launched 07:20:53.882366 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:54.455853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21944): Launched 07:20:54.584463 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:54.865429 run patchelf(pid=21945): Launched 07:20:55.051410 run osmo-stp_10.42.42.5(pid=21942): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21942)] 07:20:55.192073 run osmo-stp_10.42.42.5(pid=21942): stdout: | (launched: 2022-12-14_07:20:53.693028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:55.334328 run osmo-stp_10.42.42.5(pid=21942): stderr: | 20221214072053884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072053884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072053885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072053885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072053885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072053886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072053886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:55.476652 run osmo-stp_10.42.42.5(pid=21942): stdout: | (launched: 2022-12-14_07:20:53.693028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:55.612042 run osmo-stp_10.42.42.5(pid=21942): stderr: | 20221214072053884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072053884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072053885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072053885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072053885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072053886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072053886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:55.773165 run patchelf(pid=21945): Terminating (SIGINT) 07:20:55.959734 run patchelf(pid=21945): Terminated: ok {rc=0} 07:20:56.094956 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21942): Process ended prematurely: osmo-stp_10.42.42.5(pid=21942) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21942)] [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 07:20:56.105711 tst iperf3.py:8: Test FAILED (7.8 sec) 07:20:56.134157 run osmo-hlr_10.42.42.2(pid=21939): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21939)] 07:20:56.184685 run osmo-hlr_10.42.42.2(pid=21939): stdout: | (launched: 2022-12-14_07:20:52.660606) 07:20:56.237171 run osmo-hlr_10.42.42.2(pid=21939): stderr: | 20221214072052857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072052857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072052857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072052858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072052858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072052858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072052870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072052881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072052881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072052881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:56.289801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21932): Terminating (SIGTERM) 07:20:56.331410 run iperf3-srv_10.42.42.10(pid=21933): Terminating (SIGTERM) 07:20:56.374489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21938): Terminating (SIGTERM) 07:20:56.416694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21941): Terminating (SIGTERM) 07:20:56.458725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21944): Terminating (SIGTERM) 07:20:56.500727 --- ParallelTerminationStrategy: PID 21932 died... 07:20:56.521057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21932): Terminated: ok {rc=0} 07:20:56.567071 --- ParallelTerminationStrategy: PID 21933 died... 07:20:56.586740 run iperf3-srv_10.42.42.10(pid=21933): Terminated {rc=256} 07:20:56.632670 --- ParallelTerminationStrategy: PID 21938 died... 07:20:56.652419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21938): Terminated: ok {rc=0} 07:20:56.698358 --- ParallelTerminationStrategy: PID 21941 died... 07:20:56.718129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21941): Terminated: ok {rc=0} 07:20:56.763990 --- ParallelTerminationStrategy: PID 21944 died... 07:20:56.783702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21944): Terminated: ok {rc=0} 07:20:56.871668 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:20:58.023258 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:58.035403 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:20:58.087487 tst iperf3m4.py: using LAC 39311 07:20:58.218378 tst iperf3m4.py: using RAC 41 07:20:58.348784 tst iperf3m4.py: using CellId 39311 07:20:58.480868 tst iperf3m4.py: using BVCI 39312 07:20:58.602430 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:58.613893 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:58.625064 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:58.636176 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:58.647530 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:58.659121 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:58.670882 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:58.682296 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:20:58.693919 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:20:58.812251 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:20:58.936214 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:20:59.056524 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:20:59.174988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:20:59.383722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:59.696733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21947): Launched 07:20:59.970756 run iperf3-srv_10.42.42.10(pid=21948): Launched 07:21:00.088930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:21:00.296680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:00.608159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21949): Launched 07:21:00.897797 run iperf3-srv_10.42.42.10(pid=21950): Launched 07:21:01.032817 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:21:01.245271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:01.563614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21951): Launched 07:21:01.877706 run iperf3-srv_10.42.42.10(pid=21952): Launched 07:21:02.006649 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:21:02.217761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:02.529600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21953): Launched 07:21:02.802611 run iperf3-srv_10.42.42.10(pid=21954): Launched 07:21:02.920234 tst iperf3m4.py:8: start network... 07:21:03.127703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:03.610355 run create_hlr_db(pid=21955): Launched 07:21:03.739892 bus /gobi_6: Setting Powered False 07:21:04.800662 run create_hlr_db(pid=21955): Terminated: ok {rc=0} 07:21:05.256069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21957): Launched 07:21:05.591941 run osmo-hlr_10.42.42.2(pid=21958): Launched 07:21:05.721114 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:06.298744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21960): Launched 07:21:06.634181 run osmo-stp_10.42.42.5(pid=21961): Launched 07:21:06.760371 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:07.335839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21963): Launched 07:21:07.463929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:07.746941 run patchelf(pid=21964): Launched 07:21:07.931640 run osmo-stp_10.42.42.5(pid=21961): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21961)] 07:21:08.071952 run osmo-stp_10.42.42.5(pid=21961): stdout: | (launched: 2022-12-14_07:21:06.572814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:08.214811 run osmo-stp_10.42.42.5(pid=21961): stderr: | 20221214072106762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072106762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072106762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072106762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072106763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072106763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072106763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:08.357300 run osmo-stp_10.42.42.5(pid=21961): stdout: | (launched: 2022-12-14_07:21:06.572814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:08.493220 run osmo-stp_10.42.42.5(pid=21961): stderr: | 20221214072106762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072106762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072106762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072106762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072106763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072106763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072106763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:08.654373 run patchelf(pid=21964): Terminating (SIGINT) 07:21:08.841682 run patchelf(pid=21964): Terminated: ok {rc=0} 07:21:08.977011 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21961): Process ended prematurely: osmo-stp_10.42.42.5(pid=21961) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21961)] [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 07:21:08.987241 tst iperf3m4.py:8: Test FAILED (11.0 sec) 07:21:09.016065 run osmo-hlr_10.42.42.2(pid=21958): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21958)] 07:21:09.067042 run osmo-hlr_10.42.42.2(pid=21958): stdout: | (launched: 2022-12-14_07:21:05.530506) 07:21:09.119930 run osmo-hlr_10.42.42.2(pid=21958): stderr: | 20221214072105728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072105728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072105728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072105728 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072105728 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072105728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072105743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072105752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072105753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072105753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:09.172892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21947): Terminating (SIGTERM) 07:21:09.215045 run iperf3-srv_10.42.42.10(pid=21948): Terminating (SIGTERM) 07:21:09.257335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21949): Terminating (SIGTERM) 07:21:09.299850 run iperf3-srv_10.42.42.10(pid=21950): Terminating (SIGTERM) 07:21:09.342113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21951): Terminating (SIGTERM) 07:21:09.384427 run iperf3-srv_10.42.42.10(pid=21952): Terminating (SIGTERM) 07:21:09.426665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21953): Terminating (SIGTERM) 07:21:09.468867 run iperf3-srv_10.42.42.10(pid=21954): Terminating (SIGTERM) 07:21:09.510991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21957): Terminating (SIGTERM) 07:21:09.553361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21960): Terminating (SIGTERM) 07:21:09.595579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21963): Terminating (SIGTERM) 07:21:09.638076 --- ParallelTerminationStrategy: PID 21947 died... 07:21:09.658559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21947): Terminated: ok {rc=0} 07:21:09.705216 --- ParallelTerminationStrategy: PID 21948 died... 07:21:09.724931 run iperf3-srv_10.42.42.10(pid=21948): Terminated {rc=256} 07:21:09.771762 --- ParallelTerminationStrategy: PID 21949 died... 07:21:09.791769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21949): Terminated: ok {rc=0} 07:21:09.838217 --- ParallelTerminationStrategy: PID 21950 died... 07:21:09.858098 run iperf3-srv_10.42.42.10(pid=21950): Terminated {rc=256} 07:21:09.904075 --- ParallelTerminationStrategy: PID 21951 died... 07:21:09.923827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21951): Terminated: ok {rc=0} 07:21:09.970247 --- ParallelTerminationStrategy: PID 21952 died... 07:21:09.990113 run iperf3-srv_10.42.42.10(pid=21952): Terminated {rc=256} 07:21:10.036406 --- ParallelTerminationStrategy: PID 21953 died... 07:21:10.056335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21953): Terminated: ok {rc=0} 07:21:10.102845 --- ParallelTerminationStrategy: PID 21954 died... 07:21:10.123093 run iperf3-srv_10.42.42.10(pid=21954): Terminated {rc=256} 07:21:10.169486 --- ParallelTerminationStrategy: PID 21957 died... 07:21:10.189562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21957): Terminated: ok {rc=0} 07:21:10.236169 --- ParallelTerminationStrategy: PID 21960 died... 07:21:10.256174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21960): Terminated: ok {rc=0} 07:21:10.302524 --- ParallelTerminationStrategy: PID 21963 died... 07:21:10.322627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21963): Terminated: ok {rc=0} 07:21:10.411560 bus /gobi_4: Setting Powered False 07:21:11.511320 bus /gobi_4: Setting Powered False 07:21:12.629946 bus /gobi_1: Setting Powered False 07:21:13.729118 bus /gobi_1: Setting Powered False 07:21:14.846041 bus /gobi_0: Setting Powered False 07:21:15.945869 bus /gobi_0: Setting Powered False 07:21:17.082372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 07:21:18.200304 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:18.212430 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:21:18.265803 tst ping.py: using LAC 39312 07:21:18.395992 tst ping.py: using RAC 42 07:21:18.524413 tst ping.py: using CellId 39312 07:21:18.652710 tst ping.py: using BVCI 39313 07:21:18.774047 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:18.785582 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:18.796786 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:18.808108 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:18.819544 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:18.831015 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:18.842704 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:18.854284 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:21:18.972076 tst ping.py:19: start network... 07:21:19.177339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:19.650046 run create_hlr_db(pid=21965): Launched 07:21:19.775688 bus /gobi_6: Setting Powered False 07:21:20.836170 run create_hlr_db(pid=21965): Terminated: ok {rc=0} 07:21:21.284895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21967): Launched 07:21:21.614607 run osmo-hlr_10.42.42.2(pid=21968): Launched 07:21:21.738978 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:22.313746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21970): Launched 07:21:22.641687 run osmo-stp_10.42.42.5(pid=21971): Launched 07:21:22.767287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:23.334610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21973): Launched 07:21:23.460081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:23.736608 run patchelf(pid=21974): Launched 07:21:23.918343 run osmo-stp_10.42.42.5(pid=21971): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21971)] 07:21:24.056452 run osmo-stp_10.42.42.5(pid=21971): stdout: | (launched: 2022-12-14_07:21:22.581059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:24.196709 run osmo-stp_10.42.42.5(pid=21971): stderr: | 20221214072122772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072122772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072122772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072122773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072122774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072122774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072122774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:24.336383 run osmo-stp_10.42.42.5(pid=21971): stdout: | (launched: 2022-12-14_07:21:22.581059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:24.469364 run osmo-stp_10.42.42.5(pid=21971): stderr: | 20221214072122772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072122772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072122772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072122773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072122774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072122774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072122774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:24.627475 run patchelf(pid=21974): Terminating (SIGINT) 07:21:24.811325 run patchelf(pid=21974): Terminated: ok {rc=0} 07:21:24.943847 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21971): Process ended prematurely: osmo-stp_10.42.42.5(pid=21971) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21971)] [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 07:21:24.953521 tst ping.py:22: Test FAILED (6.7 sec) 07:21:24.981400 run osmo-hlr_10.42.42.2(pid=21968): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21968)] 07:21:25.031807 run osmo-hlr_10.42.42.2(pid=21968): stdout: | (launched: 2022-12-14_07:21:21.553796) 07:21:25.083625 run osmo-hlr_10.42.42.2(pid=21968): stderr: | 20221214072121750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072121750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072121750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072121750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072121750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072121750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072121763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072121771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072121772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072121772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:25.136648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21967): Terminating (SIGTERM) 07:21:25.178282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21970): Terminating (SIGTERM) 07:21:25.220581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21973): Terminating (SIGTERM) 07:21:25.263055 --- ParallelTerminationStrategy: PID 21967 died... 07:21:25.283313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21967): Terminated: ok {rc=0} 07:21:25.329736 --- ParallelTerminationStrategy: PID 21970 died... 07:21:25.349397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21970): Terminated: ok {rc=0} 07:21:25.395835 --- ParallelTerminationStrategy: PID 21973 died... 07:21:25.415714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21973): Terminated: ok {rc=0} 07:21:25.504295 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:21:26.591034 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:26.603093 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:21:26.656166 tst ping_idle_ping.py: using LAC 39313 07:21:26.785240 tst ping_idle_ping.py: using RAC 43 07:21:26.912321 tst ping_idle_ping.py: using CellId 39313 07:21:27.041581 tst ping_idle_ping.py: using BVCI 39314 07:21:27.153743 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:27.164927 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:27.175948 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:27.186906 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:27.198530 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:27.210002 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:27.223202 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:21:27.237616 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:21:27.360118 tst ping_idle_ping.py:24: start network... 07:21:27.581773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:28.090888 run create_hlr_db(pid=21975): Launched 07:21:28.216032 bus /gobi_6: Setting Powered False 07:21:29.280059 run create_hlr_db(pid=21975): Terminated: ok {rc=0} 07:21:29.718301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21977): Launched 07:21:30.024820 run osmo-hlr_10.42.42.2(pid=21978): Launched 07:21:30.140525 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:30.689707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21980): Launched 07:21:31.038774 run osmo-stp_10.42.42.5(pid=21981): Launched 07:21:31.243367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:31.879864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21983): Launched 07:21:32.022504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:32.309536 run patchelf(pid=21984): Launched 07:21:32.493888 run osmo-stp_10.42.42.5(pid=21981): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21981)] 07:21:32.633970 run osmo-stp_10.42.42.5(pid=21981): stdout: | (launched: 2022-12-14_07:21:30.975554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:32.775867 run osmo-stp_10.42.42.5(pid=21981): stderr: | 20221214072131314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072131314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072131314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072131314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072131315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072131315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072131315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:32.917662 run osmo-stp_10.42.42.5(pid=21981): stdout: | (launched: 2022-12-14_07:21:30.975554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:33.052939 run osmo-stp_10.42.42.5(pid=21981): stderr: | 20221214072131314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072131314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072131314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072131314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072131315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072131315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072131315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:33.214001 run patchelf(pid=21984): Terminating (SIGINT) 07:21:33.401119 run patchelf(pid=21984): Terminated: ok {rc=0} 07:21:33.536043 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21981): Process ended prematurely: osmo-stp_10.42.42.5(pid=21981) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21981)] [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 07:21:33.545779 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 07:21:33.574180 run osmo-hlr_10.42.42.2(pid=21978): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21978)] 07:21:33.625159 run osmo-hlr_10.42.42.2(pid=21978): stdout: | (launched: 2022-12-14_07:21:29.967109) 07:21:33.678107 run osmo-hlr_10.42.42.2(pid=21978): stderr: | 20221214072130140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072130141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072130141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072130141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072130141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072130141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072130153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072130161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072130161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072130161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:33.731074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21977): Terminating (SIGTERM) 07:21:33.773607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21980): Terminating (SIGTERM) 07:21:33.816060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21983): Terminating (SIGTERM) 07:21:33.859048 --- ParallelTerminationStrategy: PID 21977 died... 07:21:33.879742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21977): Terminated: ok {rc=0} 07:21:33.927613 --- ParallelTerminationStrategy: PID 21980 died... 07:21:33.948079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21980): Terminated: ok {rc=0} 07:21:33.995352 --- ParallelTerminationStrategy: PID 21983 died... 07:21:34.015642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21983): Terminated: ok {rc=0} 07:21:34.105111 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:21:35.408919 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:21:35.415443 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:21:35.448688 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:21:35.487397 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:21:35.574398 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:21:35.606776 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:21:35.644289 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:21:36.237430 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:21:36.286895 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:36.298296 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:21:36.367696 tst cs_paging_gprs_active.py: using LAC 39314 07:21:36.492137 tst cs_paging_gprs_active.py: using RAC 44 07:21:36.615136 tst cs_paging_gprs_active.py: using CellId 39314 07:21:36.739513 tst cs_paging_gprs_active.py: using BVCI 39315 07:21:36.854015 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:36.864854 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:36.875613 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:36.886331 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:36.896903 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:36.907813 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:36.918641 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:36.929322 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:36.940198 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:21:37.059380 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:21:37.181539 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:21:37.407920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:37.744129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21989): Launched 07:21:38.035106 run iperf3-srv_10.42.42.10(pid=21990): Launched 07:21:38.160363 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:21:38.385749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:38.719945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21991): Launched 07:21:39.010312 run iperf3-srv_10.42.42.10(pid=21992): Launched 07:21:39.135915 tst cs_paging_gprs_active.py:38: start network... 07:21:39.361836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:39.878072 run create_hlr_db(pid=21993): Launched 07:21:40.009988 bus /gobi_6: Setting Powered False 07:21:41.071771 run create_hlr_db(pid=21993): Terminated: ok {rc=0} 07:21:41.503577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21995): Launched 07:21:41.813555 run osmo-hlr_10.42.42.2(pid=21996): Launched 07:21:41.931735 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:42.478869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21998): Launched 07:21:42.788792 run osmo-stp_10.42.42.5(pid=21999): Launched 07:21:42.906433 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:43.439465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22001): Launched 07:21:43.557665 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:43.819658 run patchelf(pid=22002): Launched 07:21:43.991918 run osmo-stp_10.42.42.5(pid=21999): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21999)] 07:21:44.124491 run osmo-stp_10.42.42.5(pid=21999): stdout: | (launched: 2022-12-14_07:21:42.730619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:44.256171 run osmo-stp_10.42.42.5(pid=21999): stderr: | 20221214072142902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072142902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072142902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072142902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072142903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072142903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072142903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:44.388260 run osmo-stp_10.42.42.5(pid=21999): stdout: | (launched: 2022-12-14_07:21:42.730619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:44.515735 run osmo-stp_10.42.42.5(pid=21999): stderr: | 20221214072142902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072142902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072142902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072142902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072142903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072142903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072142903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:44.665825 run patchelf(pid=22002): Terminating (SIGINT) 07:21:44.841670 run patchelf(pid=22002): Terminated: ok {rc=0} 07:21:44.968039 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21999): Process ended prematurely: osmo-stp_10.42.42.5(pid=21999) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21999)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:21:44.977509 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:21:45.004485 run osmo-hlr_10.42.42.2(pid=21996): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21996)] 07:21:45.051831 run osmo-hlr_10.42.42.2(pid=21996): stdout: | (launched: 2022-12-14_07:21:41.755619) 07:21:45.101338 run osmo-hlr_10.42.42.2(pid=21996): stderr: | 20221214072141930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072141931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072141931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072141931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072141931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072141931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072141943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072141951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072141951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072141951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:45.150939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21989): Terminating (SIGTERM) 07:21:45.190799 run iperf3-srv_10.42.42.10(pid=21990): Terminating (SIGTERM) 07:21:45.230478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21991): Terminating (SIGTERM) 07:21:45.270148 run iperf3-srv_10.42.42.10(pid=21992): Terminating (SIGTERM) 07:21:45.309833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21995): Terminating (SIGTERM) 07:21:45.349532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21998): Terminating (SIGTERM) 07:21:45.389189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22001): Terminating (SIGTERM) 07:21:45.429057 --- ParallelTerminationStrategy: PID 21989 died... 07:21:45.448016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21989): Terminated: ok {rc=0} 07:21:45.492291 --- ParallelTerminationStrategy: PID 21990 died... 07:21:45.510852 run iperf3-srv_10.42.42.10(pid=21990): Terminated {rc=256} 07:21:45.554605 --- ParallelTerminationStrategy: PID 21991 died... 07:21:45.573376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21991): Terminated: ok {rc=0} 07:21:45.617179 --- ParallelTerminationStrategy: PID 21992 died... 07:21:45.635505 run iperf3-srv_10.42.42.10(pid=21992): Terminated {rc=256} 07:21:45.679065 --- ParallelTerminationStrategy: PID 21995 died... 07:21:45.697431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21995): Terminated: ok {rc=0} 07:21:45.740834 --- ParallelTerminationStrategy: PID 21998 died... 07:21:45.759743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21998): Terminated: ok {rc=0} 07:21:45.803287 --- ParallelTerminationStrategy: PID 22001 died... 07:21:45.821762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22001): Terminated: ok {rc=0} 07:21:45.917670 bus /gobi_0: Setting Powered False 07:21:47.021740 bus /gobi_0: Setting Powered False 07:21:48.141813 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:21:49.295949 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:49.308263 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:21:49.386325 tst iperf3.py: using LAC 39315 07:21:49.515895 tst iperf3.py: using RAC 45 07:21:49.645793 tst iperf3.py: using CellId 39315 07:21:49.773732 tst iperf3.py: using BVCI 39316 07:21:49.894611 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:49.906157 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:49.917401 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:49.928591 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:49.940048 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:49.951574 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:49.963273 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:49.974767 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:49.986733 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:21:50.105732 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:21:50.315463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:21:50.629731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22003): Launched 07:21:50.903778 run iperf3-srv_10.42.42.10(pid=22004): Launched 07:21:51.020327 tst iperf3.py:8: start network... 07:21:51.229150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:51.709425 run create_hlr_db(pid=22005): Launched 07:21:51.837124 bus /gobi_6: Setting Powered False 07:21:52.898364 run create_hlr_db(pid=22005): Terminated: ok {rc=0} 07:21:53.330445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22007): Launched 07:21:53.639717 run osmo-hlr_10.42.42.2(pid=22008): Launched 07:21:53.756028 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:54.288639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22010): Launched 07:21:54.598275 run osmo-stp_10.42.42.5(pid=22011): Launched 07:21:54.715904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:55.250833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22013): Launched 07:21:55.369450 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:55.631258 run patchelf(pid=22014): Launched 07:21:55.803565 run osmo-stp_10.42.42.5(pid=22011): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22011)] 07:21:55.934480 run osmo-stp_10.42.42.5(pid=22011): stdout: | (launched: 2022-12-14_07:21:54.540639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:56.066769 run osmo-stp_10.42.42.5(pid=22011): stderr: | 20221214072154709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072154709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072154709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072154710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072154710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072154710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072154711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:56.200100 run osmo-stp_10.42.42.5(pid=22011): stdout: | (launched: 2022-12-14_07:21:54.540639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:56.326521 run osmo-stp_10.42.42.5(pid=22011): stderr: | 20221214072154709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072154709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072154709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072154710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072154710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072154710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072154711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:56.476118 run patchelf(pid=22014): Terminating (SIGINT) 07:21:56.650956 run patchelf(pid=22014): Terminated: ok {rc=0} 07:21:56.777577 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22011): Process ended prematurely: osmo-stp_10.42.42.5(pid=22011) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22011)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 07:21:56.786966 tst iperf3.py:8: Test FAILED (7.5 sec) 07:21:56.814120 run osmo-hlr_10.42.42.2(pid=22008): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22008)] 07:21:56.861670 run osmo-hlr_10.42.42.2(pid=22008): stdout: | (launched: 2022-12-14_07:21:53.582135) 07:21:56.911173 run osmo-hlr_10.42.42.2(pid=22008): stderr: | 20221214072153756 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072153756 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072153756 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072153756 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072153756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072153756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072153768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072153776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072153776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072153776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:56.961565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22003): Terminating (SIGTERM) 07:21:57.001689 run iperf3-srv_10.42.42.10(pid=22004): Terminating (SIGTERM) 07:21:57.041791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22007): Terminating (SIGTERM) 07:21:57.081907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22010): Terminating (SIGTERM) 07:21:57.121966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22013): Terminating (SIGTERM) 07:21:57.162412 --- ParallelTerminationStrategy: PID 22003 died... 07:21:57.181693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22003): Terminated: ok {rc=0} 07:21:57.225841 --- ParallelTerminationStrategy: PID 22004 died... 07:21:57.244487 run iperf3-srv_10.42.42.10(pid=22004): Terminated {rc=256} 07:21:57.288358 --- ParallelTerminationStrategy: PID 22007 died... 07:21:57.307123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22007): Terminated: ok {rc=0} 07:21:57.351213 --- ParallelTerminationStrategy: PID 22010 died... 07:21:57.370127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22010): Terminated: ok {rc=0} 07:21:57.414112 --- ParallelTerminationStrategy: PID 22013 died... 07:21:57.432923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22013): Terminated: ok {rc=0} 07:21:57.519454 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:21:58.667068 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:58.679010 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:21:58.753108 tst iperf3m4.py: using LAC 39316 07:21:58.875303 tst iperf3m4.py: using RAC 46 07:21:58.994623 tst iperf3m4.py: using CellId 39316 07:21:59.116287 tst iperf3m4.py: using BVCI 39317 07:21:59.229247 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:59.240273 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:59.251107 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:59.261952 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:59.272567 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:59.283403 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:59.294370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:59.305175 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:21:59.316023 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:21:59.438706 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:21:59.563785 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:21:59.682879 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:21:59.804903 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:22:00.031471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:00.369296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22015): Launched 07:22:00.661942 run iperf3-srv_10.42.42.10(pid=22016): Launched 07:22:00.787413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:22:01.014320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:01.338790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22017): Launched 07:22:01.633821 run iperf3-srv_10.42.42.10(pid=22018): Launched 07:22:01.768019 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:22:01.981185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:02.304792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22019): Launched 07:22:02.576611 run iperf3-srv_10.42.42.10(pid=22020): Launched 07:22:02.692809 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:22:02.899975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:03.211411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22021): Launched 07:22:03.482475 run iperf3-srv_10.42.42.10(pid=22022): Launched 07:22:03.598626 tst iperf3m4.py:8: start network... 07:22:03.805856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:04.288054 run create_hlr_db(pid=22023): Launched 07:22:04.413888 bus /gobi_6: Setting Powered False 07:22:05.474855 run create_hlr_db(pid=22023): Terminated: ok {rc=0} 07:22:05.906863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22025): Launched 07:22:06.218558 run osmo-hlr_10.42.42.2(pid=22026): Launched 07:22:06.335581 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:06.886681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22028): Launched 07:22:07.197523 run osmo-stp_10.42.42.5(pid=22029): Launched 07:22:07.315555 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:07.853245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22031): Launched 07:22:07.971547 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:08.234502 run patchelf(pid=22032): Launched 07:22:08.407276 run osmo-stp_10.42.42.5(pid=22029): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22029)] 07:22:08.538161 run osmo-stp_10.42.42.5(pid=22029): stdout: | (launched: 2022-12-14_07:22:07.139328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:08.670314 run osmo-stp_10.42.42.5(pid=22029): stderr: | 20221214072207310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072207311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072207311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072207311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072207312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072207312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072207312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:08.802508 run osmo-stp_10.42.42.5(pid=22029): stdout: | (launched: 2022-12-14_07:22:07.139328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:08.928767 run osmo-stp_10.42.42.5(pid=22029): stderr: | 20221214072207310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072207311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072207311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072207311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072207312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072207312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072207312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:09.078205 run patchelf(pid=22032): Terminating (SIGINT) 07:22:09.253802 run patchelf(pid=22032): Terminated: ok {rc=0} 07:22:09.380419 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22029): Process ended prematurely: osmo-stp_10.42.42.5(pid=22029) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22029)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:22:09.390187 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:22:09.417699 run osmo-hlr_10.42.42.2(pid=22026): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22026)] 07:22:09.465385 run osmo-hlr_10.42.42.2(pid=22026): stdout: | (launched: 2022-12-14_07:22:06.159840) 07:22:09.514751 run osmo-hlr_10.42.42.2(pid=22026): stderr: | 20221214072206336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072206336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072206336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072206336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072206336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072206336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072206348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072206357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072206357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072206357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:09.564313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22015): Terminating (SIGTERM) 07:22:09.604358 run iperf3-srv_10.42.42.10(pid=22016): Terminating (SIGTERM) 07:22:09.644226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22017): Terminating (SIGTERM) 07:22:09.684013 run iperf3-srv_10.42.42.10(pid=22018): Terminating (SIGTERM) 07:22:09.723712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22019): Terminating (SIGTERM) 07:22:09.763484 run iperf3-srv_10.42.42.10(pid=22020): Terminating (SIGTERM) 07:22:09.803201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22021): Terminating (SIGTERM) 07:22:09.842765 run iperf3-srv_10.42.42.10(pid=22022): Terminating (SIGTERM) 07:22:09.882365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22025): Terminating (SIGTERM) 07:22:09.921963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22028): Terminating (SIGTERM) 07:22:09.961489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22031): Terminating (SIGTERM) 07:22:10.001351 --- ParallelTerminationStrategy: PID 22015 died... 07:22:10.020660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22015): Terminated: ok {rc=0} 07:22:10.065190 --- ParallelTerminationStrategy: PID 22016 died... 07:22:10.083931 run iperf3-srv_10.42.42.10(pid=22016): Terminated {rc=256} 07:22:10.128060 --- ParallelTerminationStrategy: PID 22017 died... 07:22:10.146697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22017): Terminated: ok {rc=0} 07:22:10.190950 --- ParallelTerminationStrategy: PID 22018 died... 07:22:10.209656 run iperf3-srv_10.42.42.10(pid=22018): Terminated {rc=256} 07:22:10.254270 --- ParallelTerminationStrategy: PID 22019 died... 07:22:10.273108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22019): Terminated: ok {rc=0} 07:22:10.316856 --- ParallelTerminationStrategy: PID 22020 died... 07:22:10.335920 run iperf3-srv_10.42.42.10(pid=22020): Terminated {rc=256} 07:22:10.379626 --- ParallelTerminationStrategy: PID 22021 died... 07:22:10.398369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22021): Terminated: ok {rc=0} 07:22:10.443101 --- ParallelTerminationStrategy: PID 22022 died... 07:22:10.461863 run iperf3-srv_10.42.42.10(pid=22022): Terminated {rc=256} 07:22:10.505647 --- ParallelTerminationStrategy: PID 22025 died... 07:22:10.524181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22025): Terminated: ok {rc=0} 07:22:10.568086 --- ParallelTerminationStrategy: PID 22028 died... 07:22:10.587024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22028): Terminated: ok {rc=0} 07:22:10.632150 --- ParallelTerminationStrategy: PID 22031 died... 07:22:10.651000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22031): Terminated: ok {rc=0} 07:22:10.736927 bus /gobi_4: Setting Powered False 07:22:11.837529 bus /gobi_4: Setting Powered False 07:22:12.952882 bus /gobi_1: Setting Powered False 07:22:14.050443 bus /gobi_1: Setting Powered False 07:22:15.165231 bus /gobi_0: Setting Powered False 07:22:16.261816 bus /gobi_0: Setting Powered False 07:22:17.380548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:22:18.481729 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:18.493583 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:22:18.563199 tst ping.py: using LAC 39317 07:22:18.691770 tst ping.py: using RAC 47 07:22:18.819500 tst ping.py: using CellId 39317 07:22:18.953106 tst ping.py: using BVCI 39318 07:22:19.074266 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:19.086132 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:19.097463 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:19.108732 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:19.120304 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:19.131992 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:19.144067 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:19.155709 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:22:19.274335 tst ping.py:19: start network... 07:22:19.479588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:19.950868 run create_hlr_db(pid=22033): Launched 07:22:20.074847 bus /gobi_6: Setting Powered False 07:22:21.135207 run create_hlr_db(pid=22033): Terminated: ok {rc=0} 07:22:21.560865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22035): Launched 07:22:21.865074 run osmo-hlr_10.42.42.2(pid=22036): Launched 07:22:21.979917 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:22.521674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22038): Launched 07:22:22.828153 run osmo-stp_10.42.42.5(pid=22039): Launched 07:22:22.943852 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:23.468360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22041): Launched 07:22:23.584635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:23.841920 run patchelf(pid=22042): Launched 07:22:24.010577 run osmo-stp_10.42.42.5(pid=22039): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22039)] 07:22:24.138808 run osmo-stp_10.42.42.5(pid=22039): stdout: | (launched: 2022-12-14_07:22:22.771119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:24.268906 run osmo-stp_10.42.42.5(pid=22039): stderr: | 20221214072222938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072222938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072222939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072222939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072222939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072222940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072222940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:24.400168 run osmo-stp_10.42.42.5(pid=22039): stdout: | (launched: 2022-12-14_07:22:22.771119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:24.523904 run osmo-stp_10.42.42.5(pid=22039): stderr: | 20221214072222938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072222938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072222939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072222939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072222939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072222940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072222940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:24.670405 run patchelf(pid=22042): Terminating (SIGINT) 07:22:24.842707 run patchelf(pid=22042): Terminated: ok {rc=0} 07:22:24.966695 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22039): Process ended prematurely: osmo-stp_10.42.42.5(pid=22039) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22039)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 07:22:24.975526 tst ping.py:22: Test FAILED (6.5 sec) 07:22:25.002364 run osmo-hlr_10.42.42.2(pid=22036): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22036)] 07:22:25.050140 run osmo-hlr_10.42.42.2(pid=22036): stdout: | (launched: 2022-12-14_07:22:21.808249) 07:22:25.099889 run osmo-hlr_10.42.42.2(pid=22036): stderr: | 20221214072221982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072221982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072221982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072221982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072221982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072221982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072221994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072222002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072222002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072222002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:25.149785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22035): Terminating (SIGTERM) 07:22:25.190039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22038): Terminating (SIGTERM) 07:22:25.229857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22041): Terminating (SIGTERM) 07:22:25.269986 --- ParallelTerminationStrategy: PID 22035 died... 07:22:25.289336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22035): Terminated: ok {rc=0} 07:22:25.333697 --- ParallelTerminationStrategy: PID 22038 died... 07:22:25.352327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22038): Terminated: ok {rc=0} 07:22:25.396091 --- ParallelTerminationStrategy: PID 22041 died... 07:22:25.414844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22041): Terminated: ok {rc=0} 07:22:25.501328 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:22:26.590964 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:26.603168 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:22:26.677153 tst ping_idle_ping.py: using LAC 39318 07:22:26.796373 tst ping_idle_ping.py: using RAC 48 07:22:26.918876 tst ping_idle_ping.py: using CellId 39318 07:22:27.038888 tst ping_idle_ping.py: using BVCI 39319 07:22:27.150939 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:27.162183 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:27.173067 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:27.183988 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:27.194827 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:27.205894 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:27.217110 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:22:27.228227 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:22:27.347356 tst ping_idle_ping.py:24: start network... 07:22:27.571952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:28.089595 run create_hlr_db(pid=22043): Launched 07:22:28.216395 bus /gobi_6: Setting Powered False 07:22:29.281296 run create_hlr_db(pid=22043): Terminated: ok {rc=0} 07:22:29.737714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22045): Launched 07:22:30.065538 run osmo-hlr_10.42.42.2(pid=22046): Launched 07:22:30.191608 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:30.763733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22048): Launched 07:22:31.110412 run osmo-stp_10.42.42.5(pid=22049): Launched 07:22:31.393059 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:32.158685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22051): Launched 07:22:32.297033 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:32.576710 run patchelf(pid=22052): Launched 07:22:32.758795 run osmo-stp_10.42.42.5(pid=22049): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22049)] 07:22:32.897680 run osmo-stp_10.42.42.5(pid=22049): stdout: | (launched: 2022-12-14_07:22:31.046899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:33.037960 run osmo-stp_10.42.42.5(pid=22049): stderr: | 20221214072231394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072231395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072231395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072231397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072231399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072231399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072231399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:33.178427 run osmo-stp_10.42.42.5(pid=22049): stdout: | (launched: 2022-12-14_07:22:31.046899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:33.311839 run osmo-stp_10.42.42.5(pid=22049): stderr: | 20221214072231394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072231395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072231395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072231397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072231399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072231399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072231399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:33.470297 run patchelf(pid=22052): Terminating (SIGINT) 07:22:33.654774 run patchelf(pid=22052): Terminated: ok {rc=0} 07:22:33.787968 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22049): Process ended prematurely: osmo-stp_10.42.42.5(pid=22049) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22049)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:22:33.797818 tst ping_idle_ping.py:27: Test FAILED (7.2 sec) 07:22:33.826051 run osmo-hlr_10.42.42.2(pid=22046): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22046)] 07:22:33.877148 run osmo-hlr_10.42.42.2(pid=22046): stdout: | (launched: 2022-12-14_07:22:30.005160) 07:22:33.929670 run osmo-hlr_10.42.42.2(pid=22046): stderr: | 20221214072230201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072230201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072230201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072230201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072230201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072230201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072230213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072230222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072230222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072230222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:33.982521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22045): Terminating (SIGTERM) 07:22:34.024778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22048): Terminating (SIGTERM) 07:22:34.067840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22051): Terminating (SIGTERM) 07:22:34.110881 --- ParallelTerminationStrategy: PID 22045 died... 07:22:34.131388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22045): Terminated: ok {rc=0} 07:22:34.178644 --- ParallelTerminationStrategy: PID 22048 died... 07:22:34.198532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22048): Terminated: ok {rc=0} 07:22:34.245227 --- ParallelTerminationStrategy: PID 22051 died... 07:22:34.265107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22051): Terminated: ok {rc=0} 07:22:34.354623 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:22:35.654032 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:22:35.660538 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:22:35.694330 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:22:35.733120 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:22:35.822633 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:22:35.855972 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:22:35.894319 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:22:36.488441 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:22:36.538891 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:36.550116 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:22:36.618271 tst cs_paging_gprs_active.py: using LAC 39319 07:22:36.740474 tst cs_paging_gprs_active.py: using RAC 49 07:22:36.861994 tst cs_paging_gprs_active.py: using CellId 39319 07:22:36.983243 tst cs_paging_gprs_active.py: using BVCI 39320 07:22:37.097812 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:37.108683 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:37.119530 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:37.130294 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:37.141127 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:37.152059 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:37.163143 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:37.174213 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:37.185306 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:22:37.309154 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:22:37.432236 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:22:37.659170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:37.995316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22056): Launched 07:22:38.286878 run iperf3-srv_10.42.42.10(pid=22057): Launched 07:22:38.412020 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:22:38.638355 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:38.974620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22058): Launched 07:22:39.266447 run iperf3-srv_10.42.42.10(pid=22059): Launched 07:22:39.394187 tst cs_paging_gprs_active.py:38: start network... 07:22:39.619480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:40.137042 run create_hlr_db(pid=22060): Launched 07:22:40.265090 bus /gobi_6: Setting Powered False 07:22:41.330638 run create_hlr_db(pid=22060): Terminated: ok {rc=0} 07:22:41.793220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22062): Launched 07:22:42.127657 run osmo-hlr_10.42.42.2(pid=22063): Launched 07:22:42.255225 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:42.828710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22065): Launched 07:22:43.162326 run osmo-stp_10.42.42.5(pid=22066): Launched 07:22:43.289827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:43.864355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22068): Launched 07:22:43.991913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:44.275268 run patchelf(pid=22069): Launched 07:22:44.460552 run osmo-stp_10.42.42.5(pid=22066): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22066)] 07:22:44.601677 run osmo-stp_10.42.42.5(pid=22066): stdout: | (launched: 2022-12-14_07:22:43.100631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:44.743906 run osmo-stp_10.42.42.5(pid=22066): stderr: | 20221214072243292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072243292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072243292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072243292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072243293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072243293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072243293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:44.886147 run osmo-stp_10.42.42.5(pid=22066): stdout: | (launched: 2022-12-14_07:22:43.100631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:45.022437 run osmo-stp_10.42.42.5(pid=22066): stderr: | 20221214072243292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072243292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072243292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072243292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072243293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072243293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072243293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:45.184602 run patchelf(pid=22069): Terminating (SIGINT) 07:22:45.373270 run patchelf(pid=22069): Terminated: ok {rc=0} 07:22:45.509243 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22066): Process ended prematurely: osmo-stp_10.42.42.5(pid=22066) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22066)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:22:45.519617 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 07:22:45.548185 run osmo-hlr_10.42.42.2(pid=22063): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22063)] 07:22:45.599653 run osmo-hlr_10.42.42.2(pid=22063): stdout: | (launched: 2022-12-14_07:22:42.066191) 07:22:45.652293 run osmo-hlr_10.42.42.2(pid=22063): stderr: | 20221214072242262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072242262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072242262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072242262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072242262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072242262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072242275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072242283 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072242283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072242283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:45.705881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22056): Terminating (SIGTERM) 07:22:45.748165 run iperf3-srv_10.42.42.10(pid=22057): Terminating (SIGTERM) 07:22:45.791254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22058): Terminating (SIGTERM) 07:22:45.834361 run iperf3-srv_10.42.42.10(pid=22059): Terminating (SIGTERM) 07:22:45.882132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22062): Terminating (SIGTERM) 07:22:45.927148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22065): Terminating (SIGTERM) 07:22:45.970819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22068): Terminating (SIGTERM) 07:22:46.015434 --- ParallelTerminationStrategy: PID 22056 died... 07:22:46.036180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22056): Terminated: ok {rc=0} 07:22:46.083645 --- ParallelTerminationStrategy: PID 22057 died... 07:22:46.104221 run iperf3-srv_10.42.42.10(pid=22057): Terminated {rc=256} 07:22:46.151492 --- ParallelTerminationStrategy: PID 22058 died... 07:22:46.172318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22058): Terminated: ok {rc=0} 07:22:46.219855 --- ParallelTerminationStrategy: PID 22059 died... 07:22:46.240304 run iperf3-srv_10.42.42.10(pid=22059): Terminated {rc=256} 07:22:46.287485 --- ParallelTerminationStrategy: PID 22062 died... 07:22:46.307901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22062): Terminated: ok {rc=0} 07:22:46.355437 --- ParallelTerminationStrategy: PID 22065 died... 07:22:46.375945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22065): Terminated: ok {rc=0} 07:22:46.423159 --- ParallelTerminationStrategy: PID 22068 died... 07:22:46.443538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22068): Terminated: ok {rc=0} 07:22:46.536590 bus /gobi_0: Setting Powered False 07:22:47.634687 bus /gobi_0: Setting Powered False 07:22:48.751018 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:22:49.903112 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:49.915494 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:22:49.991688 tst iperf3.py: using LAC 39320 07:22:50.122710 tst iperf3.py: using RAC 50 07:22:50.256097 tst iperf3.py: using CellId 39320 07:22:50.386677 tst iperf3.py: using BVCI 39321 07:22:50.510505 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:50.522115 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:50.533326 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:50.544496 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:50.556108 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:50.567966 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:50.579789 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:50.591426 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:50.603591 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:22:50.726478 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:22:50.952182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:22:51.288389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22070): Launched 07:22:51.579796 run iperf3-srv_10.42.42.10(pid=22071): Launched 07:22:51.705363 tst iperf3.py:8: start network... 07:22:51.954886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:52.472740 run create_hlr_db(pid=22072): Launched 07:22:52.599795 bus /gobi_6: Setting Powered False 07:22:53.664678 run create_hlr_db(pid=22072): Terminated: ok {rc=0} 07:22:54.127564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22074): Launched 07:22:54.461626 run osmo-hlr_10.42.42.2(pid=22075): Launched 07:22:54.589178 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:55.164605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22077): Launched 07:22:55.498146 run osmo-stp_10.42.42.5(pid=22078): Launched 07:22:55.624545 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:22:56.198400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22080): Launched 07:22:56.326848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:22:56.608847 run patchelf(pid=22081): Launched 07:22:56.794258 run osmo-stp_10.42.42.5(pid=22078): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22078)] 07:22:56.935371 run osmo-stp_10.42.42.5(pid=22078): stdout: | (launched: 2022-12-14_07:22:55.436373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:57.077658 run osmo-stp_10.42.42.5(pid=22078): stderr: | 20221214072255628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072255629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072255629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072255629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072255630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072255630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072255630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:57.220938 run osmo-stp_10.42.42.5(pid=22078): stdout: | (launched: 2022-12-14_07:22:55.436373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:57.356840 run osmo-stp_10.42.42.5(pid=22078): stderr: | 20221214072255628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072255629 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072255629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072255629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072255630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072255630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072255630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:57.518233 run patchelf(pid=22081): Terminating (SIGINT) 07:22:57.705589 run patchelf(pid=22081): Terminated: ok {rc=0} 07:22:57.841018 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22078): Process ended prematurely: osmo-stp_10.42.42.5(pid=22078) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22078)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 07:22:57.851363 tst iperf3.py:8: Test FAILED (8.0 sec) 07:22:57.880000 run osmo-hlr_10.42.42.2(pid=22075): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22075)] 07:22:57.931560 run osmo-hlr_10.42.42.2(pid=22075): stdout: | (launched: 2022-12-14_07:22:54.399926) 07:22:57.984396 run osmo-hlr_10.42.42.2(pid=22075): stderr: | 20221214072254599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072254599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072254599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072254599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072254599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072254599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072254611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072254620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072254621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072254621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:58.037689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22070): Terminating (SIGTERM) 07:22:58.079789 run iperf3-srv_10.42.42.10(pid=22071): Terminating (SIGTERM) 07:22:58.122444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22074): Terminating (SIGTERM) 07:22:58.165642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22077): Terminating (SIGTERM) 07:22:58.208613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22080): Terminating (SIGTERM) 07:22:58.251763 --- ParallelTerminationStrategy: PID 22070 died... 07:22:58.272411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22070): Terminated: ok {rc=0} 07:22:58.319330 --- ParallelTerminationStrategy: PID 22071 died... 07:22:58.339454 run iperf3-srv_10.42.42.10(pid=22071): Terminated {rc=256} 07:22:58.386007 --- ParallelTerminationStrategy: PID 22074 died... 07:22:58.406262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22074): Terminated: ok {rc=0} 07:22:58.452772 --- ParallelTerminationStrategy: PID 22077 died... 07:22:58.473206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22077): Terminated: ok {rc=0} 07:22:58.520003 --- ParallelTerminationStrategy: PID 22080 died... 07:22:58.540271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22080): Terminated: ok {rc=0} 07:22:58.628842 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:22:59.780237 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:22:59.792671 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:22:59.866688 tst iperf3m4.py: using LAC 39321 07:22:59.998199 tst iperf3m4.py: using RAC 51 07:23:00.129076 tst iperf3m4.py: using CellId 39321 07:23:00.260651 tst iperf3m4.py: using BVCI 39322 07:23:00.384119 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:00.395642 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:00.406966 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:00.418219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:00.429969 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:00.441801 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:00.453648 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:00.465499 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:00.477746 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:23:00.597618 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:23:00.722335 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:23:00.848713 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:23:00.995921 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:23:01.216831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:23:01.545683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22082): Launched 07:23:01.830706 run iperf3-srv_10.42.42.10(pid=22083): Launched 07:23:01.964157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:23:02.176267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:23:02.490678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22084): Launched 07:23:02.764340 run iperf3-srv_10.42.42.10(pid=22085): Launched 07:23:02.881312 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:23:03.090146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:23:03.405719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22086): Launched 07:23:03.678255 run iperf3-srv_10.42.42.10(pid=22087): Launched 07:23:03.794070 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:23:04.001363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:23:04.313182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22088): Launched 07:23:04.584651 run iperf3-srv_10.42.42.10(pid=22089): Launched 07:23:04.700775 tst iperf3m4.py:8: start network... 07:23:04.906972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:05.388395 run create_hlr_db(pid=22090): Launched 07:23:05.514520 bus /gobi_6: Setting Powered False 07:23:06.575645 run create_hlr_db(pid=22090): Terminated: ok {rc=0} 07:23:07.030285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22092): Launched 07:23:07.347003 run osmo-hlr_10.42.42.2(pid=22093): Launched 07:23:07.463347 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:08.016098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22095): Launched 07:23:08.326136 run osmo-stp_10.42.42.5(pid=22096): Launched 07:23:08.442646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:23:08.974891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22098): Launched 07:23:09.092897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:23:09.354160 run patchelf(pid=22099): Launched 07:23:09.525696 run osmo-stp_10.42.42.5(pid=22096): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22096)] 07:23:09.655845 run osmo-stp_10.42.42.5(pid=22096): stdout: | (launched: 2022-12-14_07:23:08.268360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:09.787780 run osmo-stp_10.42.42.5(pid=22096): stderr: | 20221214072308439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072308439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072308439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072308439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072308440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072308440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072308440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:09.920032 run osmo-stp_10.42.42.5(pid=22096): stdout: | (launched: 2022-12-14_07:23:08.268360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:10.045850 run osmo-stp_10.42.42.5(pid=22096): stderr: | 20221214072308439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072308439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072308439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072308439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072308440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072308440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072308440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:10.194927 run patchelf(pid=22099): Terminating (SIGINT) 07:23:10.369890 run patchelf(pid=22099): Terminated: ok {rc=0} 07:23:10.495867 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22096): Process ended prematurely: osmo-stp_10.42.42.5(pid=22096) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22096)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:23:10.505360 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:23:10.532568 run osmo-hlr_10.42.42.2(pid=22093): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22093)] 07:23:10.579712 run osmo-hlr_10.42.42.2(pid=22093): stdout: | (launched: 2022-12-14_07:23:07.288666) 07:23:10.628723 run osmo-hlr_10.42.42.2(pid=22093): stderr: | 20221214072307465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072307465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072307465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072307465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072307465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072307465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072307478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072307486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072307486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072307486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:10.678186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22082): Terminating (SIGTERM) 07:23:10.718570 run iperf3-srv_10.42.42.10(pid=22083): Terminating (SIGTERM) 07:23:10.758401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22084): Terminating (SIGTERM) 07:23:10.798183 run iperf3-srv_10.42.42.10(pid=22085): Terminating (SIGTERM) 07:23:10.837831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22086): Terminating (SIGTERM) 07:23:10.877408 run iperf3-srv_10.42.42.10(pid=22087): Terminating (SIGTERM) 07:23:10.917049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22088): Terminating (SIGTERM) 07:23:10.956727 run iperf3-srv_10.42.42.10(pid=22089): Terminating (SIGTERM) 07:23:10.996240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22092): Terminating (SIGTERM) 07:23:11.036193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22095): Terminating (SIGTERM) 07:23:11.076059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22098): Terminating (SIGTERM) 07:23:11.116154 --- ParallelTerminationStrategy: PID 22082 died... 07:23:11.135314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22082): Terminated: ok {rc=0} 07:23:11.179513 --- ParallelTerminationStrategy: PID 22083 died... 07:23:11.198222 run iperf3-srv_10.42.42.10(pid=22083): Terminated {rc=256} 07:23:11.242046 --- ParallelTerminationStrategy: PID 22084 died... 07:23:11.260711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22084): Terminated: ok {rc=0} 07:23:11.304350 --- ParallelTerminationStrategy: PID 22085 died... 07:23:11.323075 run iperf3-srv_10.42.42.10(pid=22085): Terminated {rc=256} 07:23:11.366922 --- ParallelTerminationStrategy: PID 22086 died... 07:23:11.385661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22086): Terminated: ok {rc=0} 07:23:11.429582 --- ParallelTerminationStrategy: PID 22087 died... 07:23:11.448322 run iperf3-srv_10.42.42.10(pid=22087): Terminated {rc=256} 07:23:11.492043 --- ParallelTerminationStrategy: PID 22088 died... 07:23:11.510714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22088): Terminated: ok {rc=0} 07:23:11.554547 --- ParallelTerminationStrategy: PID 22089 died... 07:23:11.573275 run iperf3-srv_10.42.42.10(pid=22089): Terminated {rc=256} 07:23:11.617133 --- ParallelTerminationStrategy: PID 22092 died... 07:23:11.635777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22092): Terminated: ok {rc=0} 07:23:11.679682 --- ParallelTerminationStrategy: PID 22095 died... 07:23:11.698359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22095): Terminated: ok {rc=0} 07:23:11.742164 --- ParallelTerminationStrategy: PID 22098 died... 07:23:11.760833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22098): Terminated: ok {rc=0} 07:23:11.845107 bus /gobi_4: Setting Powered False 07:23:12.943574 bus /gobi_4: Setting Powered False 07:23:14.062991 bus /gobi_1: Setting Powered False 07:23:15.161982 bus /gobi_1: Setting Powered False 07:23:16.284338 bus /gobi_0: Setting Powered False 07:23:17.404207 bus /gobi_0: Setting Powered False 07:23:18.523784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:23:19.627753 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:19.639630 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:23:19.710244 tst ping.py: using LAC 39322 07:23:19.831710 tst ping.py: using RAC 52 07:23:19.952286 tst ping.py: using CellId 39322 07:23:20.073513 tst ping.py: using BVCI 39323 07:23:20.194722 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:20.206686 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:20.218358 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:20.230156 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:20.242322 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:20.254517 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:20.266811 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:20.278466 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:23:20.396081 tst ping.py:19: start network... 07:23:20.599122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:21.068873 run create_hlr_db(pid=22100): Launched 07:23:21.191906 bus /gobi_6: Setting Powered False 07:23:22.252821 run create_hlr_db(pid=22100): Terminated: ok {rc=0} 07:23:22.699901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22102): Launched 07:23:23.030054 run osmo-hlr_10.42.42.2(pid=22103): Launched 07:23:23.156348 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:23.734489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22105): Launched 07:23:24.062984 run osmo-stp_10.42.42.5(pid=22106): Launched 07:23:24.187814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:23:24.752337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22108): Launched 07:23:24.878037 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:23:25.154753 run patchelf(pid=22109): Launched 07:23:25.336477 run osmo-stp_10.42.42.5(pid=22106): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22106)] 07:23:25.475086 run osmo-stp_10.42.42.5(pid=22106): stdout: | (launched: 2022-12-14_07:23:24.002090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:25.614776 run osmo-stp_10.42.42.5(pid=22106): stderr: | 20221214072324192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072324192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072324192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072324193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072324193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072324193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072324193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:25.754900 run osmo-stp_10.42.42.5(pid=22106): stdout: | (launched: 2022-12-14_07:23:24.002090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:25.888234 run osmo-stp_10.42.42.5(pid=22106): stderr: | 20221214072324192 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072324192 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072324192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072324193 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072324193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072324193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072324193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:26.045916 run patchelf(pid=22109): Terminating (SIGINT) 07:23:26.230625 run patchelf(pid=22109): Terminated: ok {rc=0} 07:23:26.363447 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22106): Process ended prematurely: osmo-stp_10.42.42.5(pid=22106) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22106)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 07:23:26.373071 tst ping.py:22: Test FAILED (6.7 sec) 07:23:26.401043 run osmo-hlr_10.42.42.2(pid=22103): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22103)] 07:23:26.451703 run osmo-hlr_10.42.42.2(pid=22103): stdout: | (launched: 2022-12-14_07:23:22.969596) 07:23:26.504326 run osmo-hlr_10.42.42.2(pid=22103): stderr: | 20221214072323165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072323165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072323165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072323165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072323166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072323166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072323178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072323187 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072323187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072323187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:26.556714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22102): Terminating (SIGTERM) 07:23:26.598654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22105): Terminating (SIGTERM) 07:23:26.640863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22108): Terminating (SIGTERM) 07:23:26.683311 --- ParallelTerminationStrategy: PID 22102 died... 07:23:26.703855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22102): Terminated: ok {rc=0} 07:23:26.750514 --- ParallelTerminationStrategy: PID 22105 died... 07:23:26.770608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22105): Terminated: ok {rc=0} 07:23:26.816913 --- ParallelTerminationStrategy: PID 22108 died... 07:23:26.836856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22108): Terminated: ok {rc=0} 07:23:26.926338 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:23:28.013820 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:28.026167 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:23:28.099720 tst ping_idle_ping.py: using LAC 39323 07:23:28.220607 tst ping_idle_ping.py: using RAC 53 07:23:28.340582 tst ping_idle_ping.py: using CellId 39323 07:23:28.461736 tst ping_idle_ping.py: using BVCI 39324 07:23:28.572683 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:28.583844 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:28.594495 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:28.605348 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:28.615932 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:28.626649 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:28.637660 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:23:28.648270 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:23:28.763690 tst ping_idle_ping.py:24: start network... 07:23:28.968826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:29.443541 run create_hlr_db(pid=22110): Launched 07:23:29.567729 bus /gobi_6: Setting Powered False 07:23:30.627611 run create_hlr_db(pid=22110): Terminated: ok {rc=0} 07:23:31.098251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22112): Launched 07:23:31.430787 run osmo-hlr_10.42.42.2(pid=22113): Launched 07:23:31.672798 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:32.295004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22115): Launched 07:23:32.600804 run osmo-stp_10.42.42.5(pid=22116): Launched 07:23:32.716784 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:23:33.243089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22118): Launched 07:23:33.359215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:23:33.616843 run patchelf(pid=22119): Launched 07:23:33.785904 run osmo-stp_10.42.42.5(pid=22116): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22116)] 07:23:33.914732 run osmo-stp_10.42.42.5(pid=22116): stdout: | (launched: 2022-12-14_07:23:32.543708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:34.044841 run osmo-stp_10.42.42.5(pid=22116): stderr: | 20221214072332713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072332713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072332713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072332714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072332714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072332714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072332714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:34.175079 run osmo-stp_10.42.42.5(pid=22116): stdout: | (launched: 2022-12-14_07:23:32.543708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:34.298848 run osmo-stp_10.42.42.5(pid=22116): stderr: | 20221214072332713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072332713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072332713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072332714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072332714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072332714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072332714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:34.445676 run patchelf(pid=22119): Terminating (SIGINT) 07:23:34.617557 run patchelf(pid=22119): Terminated: ok {rc=0} 07:23:34.741876 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22116): Process ended prematurely: osmo-stp_10.42.42.5(pid=22116) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22116)] [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:23:34.750720 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:23:34.777239 run osmo-hlr_10.42.42.2(pid=22113): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22113)] 07:23:34.824367 run osmo-hlr_10.42.42.2(pid=22113): stdout: | (launched: 2022-12-14_07:23:31.366559) 07:23:34.873446 run osmo-hlr_10.42.42.2(pid=22113): stderr: | 20221214072331703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072331703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072331703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072331703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072331703 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072331703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072331721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072331729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072331729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072331729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:34.923265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22112): Terminating (SIGTERM) 07:23:34.963210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22115): Terminating (SIGTERM) 07:23:35.002854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22118): Terminating (SIGTERM) 07:23:35.042708 --- ParallelTerminationStrategy: PID 22112 died... 07:23:35.061893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22112): Terminated: ok {rc=0} 07:23:35.105798 --- ParallelTerminationStrategy: PID 22115 died... 07:23:35.124444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22115): Terminated: ok {rc=0} 07:23:35.168611 --- ParallelTerminationStrategy: PID 22118 died... 07:23:35.187394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22118): Terminated: ok {rc=0} 07:23:35.272825 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:23:36.578439 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:23:36.585186 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:23:36.618544 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 07:23:36.657430 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 07:23:36.744373 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:23:36.777773 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 07:23:36.816292 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 07:23:37.413919 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 07:23:37.463631 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:37.475038 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:23:37.527620 tst cs_paging_gprs_active.py: using LAC 39324 07:23:37.652611 tst cs_paging_gprs_active.py: using RAC 54 07:23:37.785173 tst cs_paging_gprs_active.py: using CellId 39324 07:23:37.915521 tst cs_paging_gprs_active.py: using BVCI 39325 07:23:38.037630 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:38.049694 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:38.061507 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:38.073358 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:38.085232 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:38.097325 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:38.109355 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:38.121150 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:38.133386 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:23:38.259618 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:23:38.380815 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:23:38.590922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:23:38.905556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22124): Launched 07:23:39.181613 run iperf3-srv_10.42.42.10(pid=22125): Launched 07:23:39.299146 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:23:39.509865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:23:39.827465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22126): Launched 07:23:40.100179 run iperf3-srv_10.42.42.10(pid=22127): Launched 07:23:40.216619 tst cs_paging_gprs_active.py:38: start network... 07:23:40.425296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:40.907108 run create_hlr_db(pid=22128): Launched 07:23:41.035893 bus /gobi_6: Setting Powered False 07:23:42.096727 run create_hlr_db(pid=22128): Terminated: ok {rc=0} 07:23:42.530784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22130): Launched 07:23:42.842999 run osmo-hlr_10.42.42.2(pid=22131): Launched 07:23:42.961338 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:43.495450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22133): Launched 07:23:43.806581 run osmo-stp_10.42.42.5(pid=22134): Launched 07:23:43.924389 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:23:44.458980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22136): Launched 07:23:44.577224 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:23:44.840079 run patchelf(pid=22137): Launched 07:23:45.013572 run osmo-stp_10.42.42.5(pid=22134): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22134)] 07:23:45.144820 run osmo-stp_10.42.42.5(pid=22134): stdout: | (launched: 2022-12-14_07:23:43.748310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:45.277565 run osmo-stp_10.42.42.5(pid=22134): stderr: | 20221214072343920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072343920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072343920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072343921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072343921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072343921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072343921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:45.409625 run osmo-stp_10.42.42.5(pid=22134): stdout: | (launched: 2022-12-14_07:23:43.748310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:45.536090 run osmo-stp_10.42.42.5(pid=22134): stderr: | 20221214072343920 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072343920 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072343920 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072343921 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072343921 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072343921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072343921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:45.686225 run patchelf(pid=22137): Terminating (SIGINT) 07:23:45.863489 run patchelf(pid=22137): Terminated: ok {rc=0} 07:23:45.992832 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22134): Process ended prematurely: osmo-stp_10.42.42.5(pid=22134) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22134)] [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 07:23:46.003597 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:23:46.032101 run osmo-hlr_10.42.42.2(pid=22131): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22131)] 07:23:46.081383 run osmo-hlr_10.42.42.2(pid=22131): stdout: | (launched: 2022-12-14_07:23:42.784559) 07:23:46.132204 run osmo-hlr_10.42.42.2(pid=22131): stderr: | 20221214072342959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072342959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072342959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072342959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072342959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072342959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072342972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072342982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072342982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072342982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:46.184160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22124): Terminating (SIGTERM) 07:23:46.224815 run iperf3-srv_10.42.42.10(pid=22125): Terminating (SIGTERM) 07:23:46.265621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22126): Terminating (SIGTERM) 07:23:46.307301 run iperf3-srv_10.42.42.10(pid=22127): Terminating (SIGTERM) 07:23:46.351526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22130): Terminating (SIGTERM) 07:23:46.392738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22133): Terminating (SIGTERM) 07:23:46.434134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22136): Terminating (SIGTERM) 07:23:46.476660 --- ParallelTerminationStrategy: PID 22124 died... 07:23:46.496153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22124): Terminated: ok {rc=0} 07:23:46.541389 --- ParallelTerminationStrategy: PID 22125 died... 07:23:46.560393 run iperf3-srv_10.42.42.10(pid=22125): Terminated {rc=256} 07:23:46.605136 --- ParallelTerminationStrategy: PID 22126 died... 07:23:46.624793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22126): Terminated: ok {rc=0} 07:23:46.670001 --- ParallelTerminationStrategy: PID 22127 died... 07:23:46.689324 run iperf3-srv_10.42.42.10(pid=22127): Terminated {rc=256} 07:23:46.733715 --- ParallelTerminationStrategy: PID 22130 died... 07:23:46.753495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22130): Terminated: ok {rc=0} 07:23:46.798201 --- ParallelTerminationStrategy: PID 22133 died... 07:23:46.818042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22133): Terminated: ok {rc=0} 07:23:46.863395 --- ParallelTerminationStrategy: PID 22136 died... 07:23:46.883202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22136): Terminated: ok {rc=0} 07:23:46.971111 bus /gobi_0: Setting Powered False 07:23:48.067677 bus /gobi_0: Setting Powered False 07:23:49.181545 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 07:23:50.328833 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:50.341285 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:23:50.398307 tst iperf3.py: using LAC 39325 07:23:50.522181 tst iperf3.py: using RAC 55 07:23:50.644791 tst iperf3.py: using CellId 39325 07:23:50.767500 tst iperf3.py: using BVCI 39326 07:23:50.882034 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:50.893635 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:50.904827 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:50.916093 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:50.927126 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:50.938370 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:50.949710 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:50.960656 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:50.971873 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:23:51.089693 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:23:51.299750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:23:51.614665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22138): Launched 07:23:51.887601 run iperf3-srv_10.42.42.10(pid=22139): Launched 07:23:52.004197 tst iperf3.py:8: start network... 07:23:52.212113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:52.693919 run create_hlr_db(pid=22140): Launched 07:23:52.819617 bus /gobi_6: Setting Powered False 07:23:53.880532 run create_hlr_db(pid=22140): Terminated: ok {rc=0} 07:23:54.314233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22142): Launched 07:23:54.626284 run osmo-hlr_10.42.42.2(pid=22143): Launched 07:23:54.743377 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:55.278293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22145): Launched 07:23:55.589199 run osmo-stp_10.42.42.5(pid=22146): Launched 07:23:55.706966 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:23:56.241886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22148): Launched 07:23:56.360777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:23:56.624466 run patchelf(pid=22149): Launched 07:23:56.797138 run osmo-stp_10.42.42.5(pid=22146): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22146)] 07:23:56.928255 run osmo-stp_10.42.42.5(pid=22146): stdout: | (launched: 2022-12-14_07:23:55.530885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:57.061157 run osmo-stp_10.42.42.5(pid=22146): stderr: | 20221214072355701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072355701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072355702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072355702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072355702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072355702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072355703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:57.195069 run osmo-stp_10.42.42.5(pid=22146): stdout: | (launched: 2022-12-14_07:23:55.530885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:57.321801 run osmo-stp_10.42.42.5(pid=22146): stderr: | 20221214072355701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072355701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072355702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072355702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072355702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072355702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072355703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:57.471592 run patchelf(pid=22149): Terminating (SIGINT) 07:23:57.647803 run patchelf(pid=22149): Terminated: ok {rc=0} 07:23:57.774481 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22146): Process ended prematurely: osmo-stp_10.42.42.5(pid=22146) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22146)] [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 07:23:57.784185 tst iperf3.py:8: Test FAILED (7.5 sec) 07:23:57.811707 run osmo-hlr_10.42.42.2(pid=22143): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22143)] 07:23:57.859585 run osmo-hlr_10.42.42.2(pid=22143): stdout: | (launched: 2022-12-14_07:23:54.567431) 07:23:57.909362 run osmo-hlr_10.42.42.2(pid=22143): stderr: | 20221214072354742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072354742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072354742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072354742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072354742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072354742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072354755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072354763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072354763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072354763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:57.959186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22138): Terminating (SIGTERM) 07:23:57.999291 run iperf3-srv_10.42.42.10(pid=22139): Terminating (SIGTERM) 07:23:58.039294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22142): Terminating (SIGTERM) 07:23:58.079356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22145): Terminating (SIGTERM) 07:23:58.119655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22148): Terminating (SIGTERM) 07:23:58.161436 --- ParallelTerminationStrategy: PID 22138 died... 07:23:58.180798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22138): Terminated: ok {rc=0} 07:23:58.225254 --- ParallelTerminationStrategy: PID 22139 died... 07:23:58.243881 run iperf3-srv_10.42.42.10(pid=22139): Terminated {rc=256} 07:23:58.288004 --- ParallelTerminationStrategy: PID 22142 died... 07:23:58.306989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22142): Terminated: ok {rc=0} 07:23:58.351069 --- ParallelTerminationStrategy: PID 22145 died... 07:23:58.370034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22145): Terminated: ok {rc=0} 07:23:58.414346 --- ParallelTerminationStrategy: PID 22148 died... 07:23:58.433393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22148): Terminated: ok {rc=0} 07:23:58.520056 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 07:23:59.668692 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:23:59.680934 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:23:59.736345 tst iperf3m4.py: using LAC 39326 07:23:59.858593 tst iperf3m4.py: using RAC 56 07:23:59.984358 tst iperf3m4.py: using CellId 39326 07:24:00.108300 tst iperf3m4.py: using BVCI 39327 07:24:00.223202 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:00.234728 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:00.246043 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:00.257199 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:00.268223 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:00.279389 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:00.290673 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:00.301760 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:00.312920 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:24:00.435596 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:24:00.558840 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:24:00.683546 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:24:00.802114 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:24:01.027739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:24:01.385648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22150): Launched 07:24:01.714117 run iperf3-srv_10.42.42.10(pid=22173): Launched 07:24:01.883706 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:24:02.102522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:24:02.442710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22198): Launched 07:24:02.779185 run iperf3-srv_10.42.42.10(pid=22202): Launched 07:24:02.959756 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:24:03.228374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:24:03.645041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22278): Launched 07:24:04.014282 run iperf3-srv_10.42.42.10(pid=22328): Launched 07:24:04.176804 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:24:04.439764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:24:04.822766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22426): Launched 07:24:05.113901 run iperf3-srv_10.42.42.10(pid=22428): Launched 07:24:05.262898 tst iperf3m4.py:8: start network... 07:24:05.500848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:06.036285 run create_hlr_db(pid=22429): Launched 07:24:06.205825 bus /gobi_6: Setting Powered False 07:24:07.273718 run create_hlr_db(pid=22429): Terminated: ok {rc=0} 07:24:07.754741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Launched 07:24:08.107434 run osmo-hlr_10.42.42.2(pid=22434): Launched 07:24:08.365321 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:09.053106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Launched 07:24:09.408438 run osmo-stp_10.42.42.5(pid=22437): Launched 07:24:09.664809 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:24:10.327889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22439): Launched 07:24:10.471099 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:24:10.763580 run patchelf(pid=22440): Launched 07:24:10.967616 run osmo-stp_10.42.42.5(pid=22437): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] 07:24:11.114370 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-14_07:24:09.343639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:11.263508 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221214072409644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072409644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072409644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072409645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072409645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072409645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072409645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:11.410545 run osmo-stp_10.42.42.5(pid=22437): stdout: | (launched: 2022-12-14_07:24:09.343639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:11.553639 run osmo-stp_10.42.42.5(pid=22437): stderr: | 20221214072409644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072409644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072409644 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072409645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072409645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072409645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072409645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:11.722231 run patchelf(pid=22440): Terminating (SIGINT) 07:24:11.916870 run patchelf(pid=22440): Terminated: ok {rc=0} 07:24:12.057876 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 07:24:12.069582 tst iperf3m4.py:8: Test FAILED (12.4 sec) 07:24:12.101966 run osmo-hlr_10.42.42.2(pid=22434): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22434)] 07:24:12.156243 run osmo-hlr_10.42.42.2(pid=22434): stdout: | (launched: 2022-12-14_07:24:08.045461) 07:24:12.212123 run osmo-hlr_10.42.42.2(pid=22434): stderr: | 20221214072408353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072408353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072408353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072408353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072408353 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072408353 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072408375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072408383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072408384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072408384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:12.268820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22150): Terminating (SIGTERM) 07:24:12.312896 run iperf3-srv_10.42.42.10(pid=22173): Terminating (SIGTERM) 07:24:12.361289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22198): Terminating (SIGTERM) 07:24:12.406899 run iperf3-srv_10.42.42.10(pid=22202): Terminating (SIGTERM) 07:24:12.456165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22278): Terminating (SIGTERM) 07:24:12.503109 run iperf3-srv_10.42.42.10(pid=22328): Terminating (SIGTERM) 07:24:12.551251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22426): Terminating (SIGTERM) 07:24:12.597191 run iperf3-srv_10.42.42.10(pid=22428): Terminating (SIGTERM) 07:24:12.644517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminating (SIGTERM) 07:24:12.690767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminating (SIGTERM) 07:24:12.737873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22439): Terminating (SIGTERM) 07:24:12.784827 --- ParallelTerminationStrategy: PID 22150 died... 07:24:12.807218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22150): Terminated: ok {rc=0} 07:24:12.860228 --- ParallelTerminationStrategy: PID 22173 died... 07:24:12.881484 run iperf3-srv_10.42.42.10(pid=22173): Terminated {rc=256} 07:24:12.930567 --- ParallelTerminationStrategy: PID 22198 died... 07:24:12.952178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22198): Terminated: ok {rc=0} 07:24:13.001629 --- ParallelTerminationStrategy: PID 22202 died... 07:24:13.023664 run iperf3-srv_10.42.42.10(pid=22202): Terminated {rc=256} 07:24:13.073602 --- ParallelTerminationStrategy: PID 22278 died... 07:24:13.095496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22278): Terminated: ok {rc=0} 07:24:13.144926 --- ParallelTerminationStrategy: PID 22328 died... 07:24:13.167966 run iperf3-srv_10.42.42.10(pid=22328): Terminated {rc=256} 07:24:13.217862 --- ParallelTerminationStrategy: PID 22426 died... 07:24:13.240464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22426): Terminated: ok {rc=0} 07:24:13.289989 --- ParallelTerminationStrategy: PID 22428 died... 07:24:13.311623 run iperf3-srv_10.42.42.10(pid=22428): Terminated {rc=256} 07:24:13.361348 --- ParallelTerminationStrategy: PID 22433 died... 07:24:13.386036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22433): Terminated: ok {rc=0} 07:24:13.437993 --- ParallelTerminationStrategy: PID 22436 died... 07:24:13.458871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22436): Terminated: ok {rc=0} 07:24:13.511541 --- ParallelTerminationStrategy: PID 22439 died... 07:24:13.532689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22439): Terminated: ok {rc=0} 07:24:13.627260 bus /gobi_4: Setting Powered False 07:24:14.731629 bus /gobi_4: Setting Powered False 07:24:15.871610 bus /gobi_1: Setting Powered False 07:24:17.013952 bus /gobi_1: Setting Powered False 07:24:18.166448 bus /gobi_0: Setting Powered False 07:24:19.269704 bus /gobi_0: Setting Powered False 07:24:20.387833 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 07:24:21.495009 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:21.509313 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:24:21.583197 tst ping.py: using LAC 39327 07:24:21.708835 tst ping.py: using RAC 57 07:24:21.830665 tst ping.py: using CellId 39327 07:24:21.953151 tst ping.py: using BVCI 39328 07:24:22.069604 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:22.081740 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:22.093793 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:22.105661 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:22.117692 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:22.130018 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:22.142251 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:22.154254 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:24:22.276303 tst ping.py:19: start network... 07:24:22.488638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:22.983375 run create_hlr_db(pid=22441): Launched 07:24:23.147021 bus /gobi_6: Setting Powered False 07:24:24.209198 run create_hlr_db(pid=22441): Terminated: ok {rc=0} 07:24:24.657179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22443): Launched 07:24:24.986796 run osmo-hlr_10.42.42.2(pid=22444): Launched 07:24:25.229865 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:25.820081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22446): Launched 07:24:26.149592 run osmo-stp_10.42.42.5(pid=22447): Launched 07:24:26.276774 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:24:26.846229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22449): Launched 07:24:26.973146 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:24:27.251340 run patchelf(pid=22450): Launched 07:24:27.435275 run osmo-stp_10.42.42.5(pid=22447): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22447)] 07:24:27.574653 run osmo-stp_10.42.42.5(pid=22447): stdout: | (launched: 2022-12-14_07:24:26.089087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:27.715712 run osmo-stp_10.42.42.5(pid=22447): stderr: | 20221214072426282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072426282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072426282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072426283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072426283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072426283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072426283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:27.856449 run osmo-stp_10.42.42.5(pid=22447): stdout: | (launched: 2022-12-14_07:24:26.089087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:27.990365 run osmo-stp_10.42.42.5(pid=22447): stderr: | 20221214072426282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072426282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072426282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072426283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072426283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072426283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072426283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:28.149673 run patchelf(pid=22450): Terminating (SIGINT) 07:24:28.335459 run patchelf(pid=22450): Terminated: ok {rc=0} 07:24:28.468878 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22447): Process ended prematurely: osmo-stp_10.42.42.5(pid=22447) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22447)] [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 07:24:28.478654 tst ping.py:22: Test FAILED (7.0 sec) 07:24:28.507181 run osmo-hlr_10.42.42.2(pid=22444): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22444)] 07:24:28.558981 run osmo-hlr_10.42.42.2(pid=22444): stdout: | (launched: 2022-12-14_07:24:24.928248) 07:24:28.612063 run osmo-hlr_10.42.42.2(pid=22444): stderr: | 20221214072425262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072425262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072425262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072425262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072425262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072425262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072425298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072425309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072425309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072425309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:28.665612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22443): Terminating (SIGTERM) 07:24:28.707905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22446): Terminating (SIGTERM) 07:24:28.750788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22449): Terminating (SIGTERM) 07:24:28.793936 --- ParallelTerminationStrategy: PID 22443 died... 07:24:28.814853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22443): Terminated: ok {rc=0} 07:24:28.862264 --- ParallelTerminationStrategy: PID 22446 died... 07:24:28.882554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22446): Terminated: ok {rc=0} 07:24:28.929950 --- ParallelTerminationStrategy: PID 22449 died... 07:24:28.950350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22449): Terminated: ok {rc=0} 07:24:29.040003 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 07:24:30.127587 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:30.140383 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:24:30.197372 tst ping_idle_ping.py: using LAC 39328 07:24:30.325995 tst ping_idle_ping.py: using RAC 58 07:24:30.455639 tst ping_idle_ping.py: using CellId 39328 07:24:30.575906 tst ping_idle_ping.py: using BVCI 39329 07:24:30.687984 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:30.699803 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:30.711254 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:30.722515 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:30.733963 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:30.745198 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:30.756445 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:24:30.767715 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:24:30.890554 tst ping_idle_ping.py:24: start network... 07:24:31.127362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:31.650357 run create_hlr_db(pid=22451): Launched 07:24:31.809913 bus /gobi_6: Setting Powered False 07:24:32.874946 run create_hlr_db(pid=22451): Terminated: ok {rc=0} 07:24:33.333754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22453): Launched 07:24:33.662854 run osmo-hlr_10.42.42.2(pid=22454): Launched 07:24:33.789032 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:34.356054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22456): Launched 07:24:34.686353 run osmo-stp_10.42.42.5(pid=22457): Launched 07:24:34.813866 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:24:35.382525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22459): Launched 07:24:35.508375 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:24:35.786270 run patchelf(pid=22460): Launched 07:24:35.968326 run osmo-stp_10.42.42.5(pid=22457): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22457)] 07:24:36.107588 run osmo-stp_10.42.42.5(pid=22457): stdout: | (launched: 2022-12-14_07:24:34.625538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:36.248603 run osmo-stp_10.42.42.5(pid=22457): stderr: | 20221214072434816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072434816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072434816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072434817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072434817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072434817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072434817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:36.389400 run osmo-stp_10.42.42.5(pid=22457): stdout: | (launched: 2022-12-14_07:24:34.625538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:36.523810 run osmo-stp_10.42.42.5(pid=22457): stderr: | 20221214072434816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072434816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072434816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072434817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072434817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072434817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072434817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:36.682489 run patchelf(pid=22460): Terminating (SIGINT) 07:24:36.867297 run patchelf(pid=22460): Terminated: ok {rc=0} 07:24:37.000602 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22457): Process ended prematurely: osmo-stp_10.42.42.5(pid=22457) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22457)] [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 07:24:37.010491 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 07:24:37.038826 run osmo-hlr_10.42.42.2(pid=22454): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22454)] 07:24:37.089894 run osmo-hlr_10.42.42.2(pid=22454): stdout: | (launched: 2022-12-14_07:24:33.601884) 07:24:37.142958 run osmo-hlr_10.42.42.2(pid=22454): stderr: | 20221214072433799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072433799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072433799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072433799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072433799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072433799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072433811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072433820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072433820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072433820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:37.195916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22453): Terminating (SIGTERM) 07:24:37.238849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22456): Terminating (SIGTERM) 07:24:37.282361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22459): Terminating (SIGTERM) 07:24:37.325196 --- ParallelTerminationStrategy: PID 22453 died... 07:24:37.346033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22453): Terminated: ok {rc=0} 07:24:37.393135 --- ParallelTerminationStrategy: PID 22456 died... 07:24:37.413465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22456): Terminated: ok {rc=0} 07:24:37.460429 --- ParallelTerminationStrategy: PID 22459 died... 07:24:37.480472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22459): Terminated: ok {rc=0} 07:24:37.569369 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:24:38.882571 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:24:38.890124 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:24:38.924915 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:24:38.960614 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:24:39.017157 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:24:39.051562 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:24:39.086499 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:24:39.645326 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:24:39.650910 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:24:39.663120 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:24:39.735840 tst switch_tch_pdch.py: using LAC 39329 07:24:39.865364 tst switch_tch_pdch.py: using RAC 59 07:24:39.993993 tst switch_tch_pdch.py: using CellId 39329 07:24:40.123741 tst switch_tch_pdch.py: using BVCI 39330 07:24:40.245216 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:24:40.257081 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:24:40.268705 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:24:40.280359 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:24:40.292283 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:24:40.304146 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:24:40.316237 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:24:40.328105 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:24:40.447945 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:24:40.569387 tst switch_tch_pdch.py:51: start network... 07:24:40.790853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:41.298838 run create_hlr_db(pid=22464): Launched 07:24:41.424228 bus /gobi_6: Setting Powered False 07:24:42.489192 run create_hlr_db(pid=22464): Terminated: ok {rc=0} 07:24:42.927410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22466): Launched 07:24:43.232929 run osmo-hlr_10.42.42.2(pid=22467): Launched 07:24:43.348879 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:43.894383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22469): Launched 07:24:44.199869 run osmo-stp_10.42.42.5(pid=22470): Launched 07:24:44.315026 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:24:44.839897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22472): Launched 07:24:44.957231 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:24:45.214283 run patchelf(pid=22473): Launched 07:24:45.384598 run osmo-stp_10.42.42.5(pid=22470): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22470)] 07:24:45.513926 run osmo-stp_10.42.42.5(pid=22470): stdout: | (launched: 2022-12-14_07:24:44.142969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:45.644052 run osmo-stp_10.42.42.5(pid=22470): stderr: | 20221214072444317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072444317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072444318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072444318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072444319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072444319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072444319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:45.774450 run osmo-stp_10.42.42.5(pid=22470): stdout: | (launched: 2022-12-14_07:24:44.142969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:45.900117 run osmo-stp_10.42.42.5(pid=22470): stderr: | 20221214072444317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072444317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072444318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072444318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072444319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072444319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072444319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:46.053245 run patchelf(pid=22473): Terminating (SIGINT) 07:24:46.228920 run patchelf(pid=22473): Terminated: ok {rc=0} 07:24:46.355243 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22470): Process ended prematurely: osmo-stp_10.42.42.5(pid=22470) [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22470)] [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:24:46.364710 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:24:46.392265 run osmo-hlr_10.42.42.2(pid=22467): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22467)] 07:24:46.441074 run osmo-hlr_10.42.42.2(pid=22467): stdout: | (launched: 2022-12-14_07:24:43.175317) 07:24:46.491039 run osmo-hlr_10.42.42.2(pid=22467): stderr: | 20221214072443350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072443350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072443351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072443351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072443351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072443351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072443363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072443373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072443373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072443373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:46.541499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22466): Terminating (SIGTERM) 07:24:46.583103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22469): Terminating (SIGTERM) 07:24:46.625571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22472): Terminating (SIGTERM) 07:24:46.666556 --- ParallelTerminationStrategy: PID 22466 died... 07:24:46.686085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22466): Terminated: ok {rc=0} 07:24:46.730904 --- ParallelTerminationStrategy: PID 22469 died... 07:24:46.750381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22469): Terminated: ok {rc=0} 07:24:46.795151 --- ParallelTerminationStrategy: PID 22472 died... 07:24:46.814496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22472): Terminated: ok {rc=0} 07:24:46.899297 bus /gobi_0: Setting Powered False 07:24:47.995189 bus /gobi_0: Setting Powered False 07:24:49.108688 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:24:50.381352 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:24:50.387865 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:24:50.422476 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:24:50.458641 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:24:50.516818 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:24:50.551516 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:24:50.587048 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:24:51.138867 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:24:51.144445 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:24:51.155882 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:24:51.229362 tst switch_tch_pdch.py: using LAC 39330 07:24:51.357193 tst switch_tch_pdch.py: using RAC 60 07:24:51.486933 tst switch_tch_pdch.py: using CellId 39330 07:24:51.610118 tst switch_tch_pdch.py: using BVCI 39331 07:24:51.720029 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:24:51.731417 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:24:51.742762 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:24:51.753815 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:24:51.764879 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:24:51.775935 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:24:51.787123 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:24:51.798110 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:24:51.919970 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:24:52.039927 tst switch_tch_pdch.py:51: start network... 07:24:52.245395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:52.690731 run create_hlr_db(pid=22478): Launched 07:24:52.816359 bus /gobi_6: Setting Powered False 07:24:53.877570 run create_hlr_db(pid=22478): Terminated: ok {rc=0} 07:24:54.297630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22480): Launched 07:24:54.628874 run osmo-hlr_10.42.42.2(pid=22481): Launched 07:24:54.753412 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:55.288379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22483): Launched 07:24:55.617124 run osmo-stp_10.42.42.5(pid=22484): Launched 07:24:55.742957 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:24:56.278590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22486): Launched 07:24:56.403410 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:24:56.680347 run patchelf(pid=22487): Launched 07:24:56.862914 run osmo-stp_10.42.42.5(pid=22484): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22484)] 07:24:57.001453 run osmo-stp_10.42.42.5(pid=22484): stdout: | (launched: 2022-12-14_07:24:55.556415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:57.141440 run osmo-stp_10.42.42.5(pid=22484): stderr: | 20221214072455749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072455749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072455749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072455750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072455750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072455750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072455750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:57.281888 run osmo-stp_10.42.42.5(pid=22484): stdout: | (launched: 2022-12-14_07:24:55.556415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:57.415166 run osmo-stp_10.42.42.5(pid=22484): stderr: | 20221214072455749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072455749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072455749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072455750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072455750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072455750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072455750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:57.573681 run patchelf(pid=22487): Terminating (SIGINT) 07:24:57.757588 run patchelf(pid=22487): Terminated: ok {rc=0} 07:24:57.889991 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=22484): Process ended prematurely: osmo-stp_10.42.42.5(pid=22484) [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22484)] [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:24:57.899627 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:24:57.927553 run osmo-hlr_10.42.42.2(pid=22481): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22481)] 07:24:57.978333 run osmo-hlr_10.42.42.2(pid=22481): stdout: | (launched: 2022-12-14_07:24:54.567993) 07:24:58.031183 run osmo-hlr_10.42.42.2(pid=22481): stderr: | 20221214072454766 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072454766 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072454766 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072454766 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072454766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072454766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072454778 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072454787 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072454787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072454787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:58.084203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22480): Terminating (SIGTERM) 07:24:58.126367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22483): Terminating (SIGTERM) 07:24:58.169217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22486): Terminating (SIGTERM) 07:24:58.211771 --- ParallelTerminationStrategy: PID 22480 died... 07:24:58.232459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22480): Terminated: ok {rc=0} 07:24:58.279257 --- ParallelTerminationStrategy: PID 22483 died... 07:24:58.298950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22483): Terminated: ok {rc=0} 07:24:58.345465 --- ParallelTerminationStrategy: PID 22486 died... 07:24:58.365326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22486): Terminated: ok {rc=0} 07:24:58.453679 bus /gobi_0: Setting Powered False 07:24:59.551455 bus /gobi_0: Setting Powered False 07:25:00.668559 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 07:25:01.936524 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:01.942932 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:25:01.989514 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 07:25:01.998504 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 07:25:02.077800 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:25:02.119777 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 07:25:02.127921 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 07:25:02.650017 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 07:25:02.655544 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 07:25:02.667404 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:25:02.725373 tst mo_mt_sms.py: using LAC 39331 07:25:02.853304 tst mo_mt_sms.py: using RAC 61 07:25:02.981152 tst mo_mt_sms.py: using CellId 39331 07:25:03.107572 tst mo_mt_sms.py: using BVCI 39332 07:25:03.227474 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:25:03.345363 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:25:03.461674 tst mo_mt_sms.py:9: start nitb and bts... 07:25:03.667080 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:25:04.285788 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22494): Launched 07:25:04.592060 run osmo-nitb_10.42.42.2(pid=22495): Launched 07:25:04.759895 run osmo-nitb_10.42.42.2(pid=22495): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22495)] 07:25:04.895980 run osmo-nitb_10.42.42.2(pid=22495): stdout: | (launched: 2022-12-14_07:25:04.535336) 07:25:05.033396 run osmo-nitb_10.42.42.2(pid=22495): stderr: | (launched: 2022-12-14_07:25:04.580552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:25:05.170904 run osmo-nitb_10.42.42.2(pid=22495): stdout: | (launched: 2022-12-14_07:25:04.535336) 07:25:05.302428 run osmo-nitb_10.42.42.2(pid=22495): stderr: | (launched: 2022-12-14_07:25:04.580552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22495): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22495) [trial-2401↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22495)] 07:25:05.706388 tst osmo-nitb_10.42.42.2(pid=22495): stdout: | (launched: 2022-12-14_07:25:04.535336) 07:25:05.829960 tst osmo-nitb_10.42.42.2(pid=22495): stderr: | (launched: 2022-12-14_07:25:04.580552) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:25:05.975402 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=22495): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22495) [trial-2401↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22495)] [trial-2401↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 07:25:05.983855 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 07:25:05.990381 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22494): Terminating (SIGTERM) 07:25:06.200439 --- ParallelTerminationStrategy: PID 22494 died... 07:25:06.221188 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22494): Terminated: ok {rc=0} 07:25:06.308541 bus /sierra_3: Setting Powered False 07:25:07.411803 bus /sierra_3: Setting Powered False 07:25:08.530878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 sms:trx-sysmocell5000 --------------------------------------------------------------------- 07:25:09.732249 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:09.736767 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:25:09.771439 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 07:25:09.800684 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 07:25:09.856770 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:25:09.891434 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 07:25:09.918854 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 07:25:10.469357 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 07:25:10.474902 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:10.486437 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:25:10.538535 tst mo_mt_sms.py: using LAC 39332 07:25:10.667253 tst mo_mt_sms.py: using RAC 62 07:25:10.796727 tst mo_mt_sms.py: using CellId 39332 07:25:10.925102 tst mo_mt_sms.py: using BVCI 39333 07:25:11.044136 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:11.055671 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:11.067023 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:11.078373 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:11.090274 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:11.102190 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:25:11.220513 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:25:11.342566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:11.849936 run create_hlr_db(pid=22499): Launched 07:25:11.976134 bus /sierra_2: Setting Powered False 07:25:13.040859 run create_hlr_db(pid=22499): Terminated: ok {rc=0} 07:25:13.498040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22501): Launched 07:25:13.825413 run osmo-hlr_10.42.42.2(pid=22502): Launched 07:25:13.951021 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:14.517091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22504): Launched 07:25:14.845694 run osmo-stp_10.42.42.5(pid=22505): Launched 07:25:14.971692 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:15.563666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22507): Launched 07:25:15.914733 run osmo-msc_10.42.42.6(pid=22508): Launched 07:25:16.277766 run osmo-stp_10.42.42.5(pid=22505): ERR: Terminated: ERROR {rc=1} [trial-2401↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22505)] 07:25:16.449068 run osmo-stp_10.42.42.5(pid=22505): stdout: | (launched: 2022-12-14_07:25:14.785073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:16.674954 run osmo-stp_10.42.42.5(pid=22505): stderr: | 20221214072514979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072514979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072514979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072514980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072514980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072514980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072514980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:16.840803 run osmo-stp_10.42.42.5(pid=22505): stdout: | (launched: 2022-12-14_07:25:14.785073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:16.995415 run osmo-stp_10.42.42.5(pid=22505): stderr: | 20221214072514979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072514979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072514979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072514980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072514980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072514980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072514980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:17.159637 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=22505): Process ended prematurely: osmo-stp_10.42.42.5(pid=22505) [trial-2401↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22505)] [trial-2401↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 07:25:17.169811 tst mo_mt_sms.py:16: Test FAILED (6.7 sec) 07:25:17.198966 run osmo-hlr_10.42.42.2(pid=22502): ERR: Terminated: ERROR {rc=237} [trial-2401↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22502)] 07:25:17.254753 run osmo-hlr_10.42.42.2(pid=22502): stdout: | (launched: 2022-12-14_07:25:13.764867) 07:25:17.309499 run osmo-hlr_10.42.42.2(pid=22502): stderr: | 20221214072513962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072513962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072513962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072513962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072513963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072513963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072513976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072513984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072513984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072513984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:17.385404 run osmo-msc_10.42.42.6(pid=22508): ERR: Terminated: ERROR {rc=2} [trial-2401↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22508)] 07:25:17.436299 run osmo-msc_10.42.42.6(pid=22508): stdout: | (launched: 2022-12-14_07:25:15.841505) 07:25:17.490007 run osmo-msc_10.42.42.6(pid=22508): stderr: | 20221214072516303 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072516303 DLGLOBAL DEBUG validating counter group 0x7f8e098cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072516304 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072516304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072516304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072516304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072516317 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072516318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072516318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072516318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:17.543719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22501): Terminating (SIGTERM) 07:25:17.586277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22504): Terminating (SIGTERM) 07:25:17.629512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22507): Terminating (SIGTERM) 07:25:17.672907 --- ParallelTerminationStrategy: PID 22501 died... 07:25:17.694201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22501): Terminated: ok {rc=0} 07:25:17.742022 --- ParallelTerminationStrategy: PID 22504 died... 07:25:17.762863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22504): Terminated: ok {rc=0} 07:25:17.810285 --- ParallelTerminationStrategy: PID 22507 died... 07:25:17.830976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22507): Terminated: ok {rc=0} 07:25:17.921793 bus /sierra_3: Setting Powered False 07:25:19.021663 bus /sierra_3: Setting Powered False 07:25:20.138394 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 07:25:21.376319 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:21.380461 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:25:21.415000 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 07:25:21.423076 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 07:25:21.459635 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:25:21.494758 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 07:25:21.502229 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 07:25:22.021608 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 07:25:22.027057 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 07:25:22.038790 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:25:22.093389 tst assert_extension.py: using LAC 39333 07:25:22.221593 tst assert_extension.py: using RAC 63 07:25:22.352206 tst assert_extension.py: using CellId 39333 07:25:22.481434 tst assert_extension.py: using BVCI 39334 07:25:22.593719 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 07:25:22.712702 tst assert_extension.py:10: start nitb and bts... 07:25:22.933830 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:25:23.602876 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22513): Launched 07:25:23.931473 run osmo-nitb_10.42.42.2(pid=22514): Launched 07:25:24.113287 run osmo-nitb_10.42.42.2(pid=22514): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22514)] 07:25:24.259553 run osmo-nitb_10.42.42.2(pid=22514): stdout: | (launched: 2022-12-14_07:25:23.871275) 07:25:24.407497 run osmo-nitb_10.42.42.2(pid=22514): stderr: | (launched: 2022-12-14_07:25:23.919584) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:25:24.555097 run osmo-nitb_10.42.42.2(pid=22514): stdout: | (launched: 2022-12-14_07:25:23.871275) 07:25:24.696622 run osmo-nitb_10.42.42.2(pid=22514): stderr: | (launched: 2022-12-14_07:25:23.919584) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=22514): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22514) [trial-2401↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22514)] 07:25:25.055607 tst osmo-nitb_10.42.42.2(pid=22514): stdout: | (launched: 2022-12-14_07:25:23.871275) 07:25:25.189217 tst osmo-nitb_10.42.42.2(pid=22514): stderr: | (launched: 2022-12-14_07:25:23.919584) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:25:25.346515 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=22514): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22514) [trial-2401↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22514)] [trial-2401↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 07:25:25.355834 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:25:25.363235 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22513): Terminating (SIGTERM) 07:25:25.574389 --- ParallelTerminationStrategy: PID 22513 died... 07:25:25.596431 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=22513): Terminated: ok {rc=0} 07:25:25.685800 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 07:25:26.863425 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:26.867302 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:25:26.900791 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 07:25:26.927946 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 07:25:26.963231 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:25:26.996766 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 07:25:27.023179 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 07:25:27.555990 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 07:25:27.560897 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:27.572129 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:25:27.620332 tst assert_extension.py: using LAC 39334 07:25:27.740445 tst assert_extension.py: using RAC 64 07:25:27.862539 tst assert_extension.py: using CellId 39334 07:25:27.983486 tst assert_extension.py: using BVCI 39335 07:25:28.094583 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:28.105773 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:28.116594 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:28.127247 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:28.137925 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:28.148532 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 07:25:28.269793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:28.777677 run create_hlr_db(pid=22518): Launched 07:25:28.903103 bus /sierra_2: Setting Powered False 07:25:29.968280 run create_hlr_db(pid=22518): Terminated: ok {rc=0} 07:25:30.425867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22520): Launched 07:25:30.756898 run osmo-hlr_10.42.42.2(pid=22521): Launched 07:25:30.883794 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:31.692530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22523): Launched 07:25:32.031641 run osmo-stp_10.42.42.5(pid=22524): Launched 07:25:32.351954 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:32.897422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22526): Launched 07:25:33.199959 run osmo-msc_10.42.42.6(pid=22527): Launched 07:25:33.367924 run osmo-stp_10.42.42.5(pid=22524): ERR: Terminated: ERROR {rc=1} [trial-2401↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22524)] 07:25:33.494548 run osmo-stp_10.42.42.5(pid=22524): stdout: | (launched: 2022-12-14_07:25:31.970975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:33.621188 run osmo-stp_10.42.42.5(pid=22524): stderr: | 20221214072532165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072532165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072532166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072532166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072532167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072532167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072532167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:33.745798 run osmo-stp_10.42.42.5(pid=22524): stdout: | (launched: 2022-12-14_07:25:31.970975) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:33.865862 run osmo-stp_10.42.42.5(pid=22524): stderr: | 20221214072532165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072532165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072532166 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072532166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072532167 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072532167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072532167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:34.008611 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=22524): Process ended prematurely: osmo-stp_10.42.42.5(pid=22524) [trial-2401↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22524)] [trial-2401↪ussd:trx-sysmocell5000↪assert_extension.py:17] 07:25:34.017176 tst assert_extension.py:17: Test FAILED (6.4 sec) 07:25:34.043282 run osmo-hlr_10.42.42.2(pid=22521): ERR: Terminated: ERROR {rc=237} [trial-2401↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22521)] 07:25:34.091210 run osmo-hlr_10.42.42.2(pid=22521): stdout: | (launched: 2022-12-14_07:25:30.696058) 07:25:34.140769 run osmo-hlr_10.42.42.2(pid=22521): stderr: | 20221214072530976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072530976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072530976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072530976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072530976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072530976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072530993 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072531001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072531001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072531001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:34.209435 run osmo-msc_10.42.42.6(pid=22527): ERR: Terminated: ERROR {rc=2} [trial-2401↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22527)] 07:25:34.256875 run osmo-msc_10.42.42.6(pid=22527): stdout: | (launched: 2022-12-14_07:25:33.143631) 07:25:34.305876 run osmo-msc_10.42.42.6(pid=22527): stderr: | 20221214072533412 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072533413 DLGLOBAL DEBUG validating counter group 0x7f50b614dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072533413 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072533413 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072533413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072533413 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072533415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072533415 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072533415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072533415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:34.355594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22520): Terminating (SIGTERM) 07:25:34.395224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22523): Terminating (SIGTERM) 07:25:34.435246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22526): Terminating (SIGTERM) 07:25:34.475395 --- ParallelTerminationStrategy: PID 22520 died... 07:25:34.494753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22520): Terminated: ok {rc=0} 07:25:34.538757 --- ParallelTerminationStrategy: PID 22523 died... 07:25:34.557471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22523): Terminated: ok {rc=0} 07:25:34.601316 --- ParallelTerminationStrategy: PID 22526 died... 07:25:34.619820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22526): Terminated: ok {rc=0} 07:25:34.704126 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:25:35.916874 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:35.924181 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:25:35.959309 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:25:35.987121 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:25:36.045062 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:25:36.080188 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:25:36.108147 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:25:36.655837 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:25:36.710863 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:36.723036 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:25:36.797447 tst mo_mt_call.py: using LAC 39335 07:25:36.927198 tst mo_mt_call.py: using RAC 65 07:25:37.056788 tst mo_mt_call.py: using CellId 39335 07:25:37.184518 tst mo_mt_call.py: using BVCI 39336 07:25:37.305983 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:37.317884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:37.329625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:37.341401 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:37.353541 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:37.365575 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:25:37.485545 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:25:37.606954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:38.117977 run create_hlr_db(pid=22532): Launched 07:25:38.245852 bus /sierra_2: Setting Powered False 07:25:39.310233 run create_hlr_db(pid=22532): Terminated: ok {rc=0} 07:25:39.750054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22534): Launched 07:25:40.058337 run osmo-hlr_10.42.42.2(pid=22535): Launched 07:25:40.174898 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:40.702668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22537): Launched 07:25:41.009383 run osmo-stp_10.42.42.5(pid=22538): Launched 07:25:41.127190 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:41.686151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22540): Launched 07:25:41.995909 run osmo-msc_10.42.42.6(pid=22541): Launched 07:25:42.167101 run osmo-stp_10.42.42.5(pid=22538): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22538)] 07:25:42.296221 run osmo-stp_10.42.42.5(pid=22538): stdout: | (launched: 2022-12-14_07:25:40.952406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:42.425734 run osmo-stp_10.42.42.5(pid=22538): stderr: | 20221214072541121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072541122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072541122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072541122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072541123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072541123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072541123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:42.552638 run osmo-stp_10.42.42.5(pid=22538): stdout: | (launched: 2022-12-14_07:25:40.952406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:42.673733 run osmo-stp_10.42.42.5(pid=22538): stderr: | 20221214072541121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072541122 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072541122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072541122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072541123 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072541123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072541123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:42.818596 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22538): Process ended prematurely: osmo-stp_10.42.42.5(pid=22538) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22538)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:25:42.827720 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:25:42.854115 run osmo-hlr_10.42.42.2(pid=22535): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22535)] 07:25:42.901652 run osmo-hlr_10.42.42.2(pid=22535): stdout: | (launched: 2022-12-14_07:25:40.001367) 07:25:42.950918 run osmo-hlr_10.42.42.2(pid=22535): stderr: | 20221214072540178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072540178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072540178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072540178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072540178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072540178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072540190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072540198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072540199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072540199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:43.019612 run osmo-msc_10.42.42.6(pid=22541): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22541)] 07:25:43.066840 run osmo-msc_10.42.42.6(pid=22541): stdout: | (launched: 2022-12-14_07:25:41.938628) 07:25:43.116044 run osmo-msc_10.42.42.6(pid=22541): stderr: | 20221214072542208 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072542208 DLGLOBAL DEBUG validating counter group 0x7f201bfe8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072542208 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072542208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072542208 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072542208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072542210 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072542211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072542211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072542211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:43.165480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22534): Terminating (SIGTERM) 07:25:43.204649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22537): Terminating (SIGTERM) 07:25:43.243826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22540): Terminating (SIGTERM) 07:25:43.284034 --- ParallelTerminationStrategy: PID 22534 died... 07:25:43.303021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22534): Terminated: ok {rc=0} 07:25:43.346646 --- ParallelTerminationStrategy: PID 22537 died... 07:25:43.364930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22537): Terminated: ok {rc=0} 07:25:43.408394 --- ParallelTerminationStrategy: PID 22540 died... 07:25:43.426896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22540): Terminated: ok {rc=0} 07:25:43.512105 bus /sierra_3: Setting Powered False 07:25:44.611258 bus /sierra_3: Setting Powered False 07:25:45.724586 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:25:46.868913 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:46.881594 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:25:46.952857 tst mo_mt_call_osmux.py: using LAC 39336 07:25:47.075755 tst mo_mt_call_osmux.py: using RAC 66 07:25:47.207230 tst mo_mt_call_osmux.py: using CellId 39336 07:25:47.339197 tst mo_mt_call_osmux.py: using BVCI 39337 07:25:47.461534 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:47.473594 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:47.485432 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:47.497114 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:47.509786 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:25:47.522130 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:25:47.646690 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:25:47.766531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:48.244256 run create_hlr_db(pid=22543): Launched 07:25:48.375289 bus /sierra_2: Setting Powered False 07:25:49.440835 run create_hlr_db(pid=22543): Terminated: ok {rc=0} 07:25:49.879939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22545): Launched 07:25:50.189724 run osmo-hlr_10.42.42.2(pid=22546): Launched 07:25:50.306256 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:50.860047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22548): Launched 07:25:51.167936 run osmo-stp_10.42.42.5(pid=22549): Launched 07:25:51.284655 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:51.838286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22551): Launched 07:25:52.156292 run osmo-msc_10.42.42.6(pid=22555): Launched 07:25:52.327826 run osmo-stp_10.42.42.5(pid=22549): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22549)] 07:25:52.457583 run osmo-stp_10.42.42.5(pid=22549): stdout: | (launched: 2022-12-14_07:25:51.110735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:52.586993 run osmo-stp_10.42.42.5(pid=22549): stderr: | 20221214072551281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072551281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072551282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072551282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072551283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072551283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072551283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:52.714287 run osmo-stp_10.42.42.5(pid=22549): stdout: | (launched: 2022-12-14_07:25:51.110735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:52.835512 run osmo-stp_10.42.42.5(pid=22549): stderr: | 20221214072551281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072551281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072551282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072551282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072551283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072551283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072551283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:52.980366 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22549): Process ended prematurely: osmo-stp_10.42.42.5(pid=22549) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22549)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:25:52.989622 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:25:53.015916 run osmo-hlr_10.42.42.2(pid=22546): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22546)] 07:25:53.063928 run osmo-hlr_10.42.42.2(pid=22546): stdout: | (launched: 2022-12-14_07:25:50.132779) 07:25:53.113638 run osmo-hlr_10.42.42.2(pid=22546): stderr: | 20221214072550309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072550309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072550309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072550309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072550309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072550309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072550322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072550332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072550332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072550332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:53.182480 run osmo-msc_10.42.42.6(pid=22555): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22555)] 07:25:53.230013 run osmo-msc_10.42.42.6(pid=22555): stdout: | (launched: 2022-12-14_07:25:52.098909) 07:25:53.279333 run osmo-msc_10.42.42.6(pid=22555): stderr: | 20221214072552371 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072552371 DLGLOBAL DEBUG validating counter group 0x7f2550a1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072552371 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072552371 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072552372 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072552372 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072552374 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072552374 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072552374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072552374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:53.328941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22545): Terminating (SIGTERM) 07:25:53.368742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22548): Terminating (SIGTERM) 07:25:53.408681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22551): Terminating (SIGTERM) 07:25:53.448759 --- ParallelTerminationStrategy: PID 22545 died... 07:25:53.467963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22545): Terminated: ok {rc=0} 07:25:53.512016 --- ParallelTerminationStrategy: PID 22548 died... 07:25:53.530747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22548): Terminated: ok {rc=0} 07:25:53.574529 --- ParallelTerminationStrategy: PID 22551 died... 07:25:53.593067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22551): Terminated: ok {rc=0} 07:25:53.679150 bus /sierra_3: Setting Powered False 07:25:54.778073 bus /sierra_3: Setting Powered False 07:25:55.892848 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:25:57.145519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:57.152197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:25:57.185640 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:25:57.212494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:25:57.265433 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:25:57.299986 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:25:57.327852 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:25:57.875871 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:25:57.924729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:25:57.936171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:25:58.006767 tst mo_mt_call.py: using LAC 39337 07:25:58.129358 tst mo_mt_call.py: using RAC 67 07:25:58.248796 tst mo_mt_call.py: using CellId 39337 07:25:58.369157 tst mo_mt_call.py: using BVCI 39338 07:25:58.479762 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:25:58.491102 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:25:58.502238 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:25:58.513407 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:25:58.524563 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:25:58.535721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:25:58.652749 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:25:58.770709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:59.245836 run create_hlr_db(pid=22560): Launched 07:25:59.371194 bus /sierra_2: Setting Powered False 07:26:00.432387 run create_hlr_db(pid=22560): Terminated: ok {rc=0} 07:26:00.884302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22562): Launched 07:26:01.224938 run osmo-hlr_10.42.42.2(pid=22563): Launched 07:26:01.506516 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:02.157715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22565): Launched 07:26:02.478129 run osmo-stp_10.42.42.5(pid=22566): Launched 07:26:02.596663 run osmo-msc_10.42.42.6: Starting osmo-msc 07:26:03.156662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22568): Launched 07:26:03.465657 run osmo-msc_10.42.42.6(pid=22569): Launched 07:26:03.640727 run osmo-stp_10.42.42.5(pid=22566): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22566)] 07:26:03.770665 run osmo-stp_10.42.42.5(pid=22566): stdout: | (launched: 2022-12-14_07:26:02.421165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:03.900057 run osmo-stp_10.42.42.5(pid=22566): stderr: | 20221214072602591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072602591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072602592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072602592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072602593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072602593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072602593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:04.027661 run osmo-stp_10.42.42.5(pid=22566): stdout: | (launched: 2022-12-14_07:26:02.421165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:04.150232 run osmo-stp_10.42.42.5(pid=22566): stderr: | 20221214072602591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072602591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072602592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072602592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072602593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072602593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072602593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:04.296510 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22566): Process ended prematurely: osmo-stp_10.42.42.5(pid=22566) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22566)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:26:04.305559 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:26:04.331994 run osmo-hlr_10.42.42.2(pid=22563): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22563)] 07:26:04.379857 run osmo-hlr_10.42.42.2(pid=22563): stdout: | (launched: 2022-12-14_07:26:01.166663) 07:26:04.429507 run osmo-hlr_10.42.42.2(pid=22563): stderr: | 20221214072601382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072601382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072601382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072601382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072601382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072601382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072601398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072601409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072601409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072601409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:04.499046 run osmo-msc_10.42.42.6(pid=22569): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22569)] 07:26:04.546941 run osmo-msc_10.42.42.6(pid=22569): stdout: | (launched: 2022-12-14_07:26:03.407703) 07:26:04.597149 run osmo-msc_10.42.42.6(pid=22569): stderr: | 20221214072603679 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072603679 DLGLOBAL DEBUG validating counter group 0x7fb186da1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072603679 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072603679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072603680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072603680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072603681 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072603682 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072603682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072603682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:04.647213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22562): Terminating (SIGTERM) 07:26:04.687210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22565): Terminating (SIGTERM) 07:26:04.727023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22568): Terminating (SIGTERM) 07:26:04.767217 --- ParallelTerminationStrategy: PID 22562 died... 07:26:04.786259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22562): Terminated: ok {rc=0} 07:26:04.830169 --- ParallelTerminationStrategy: PID 22565 died... 07:26:04.848658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22565): Terminated: ok {rc=0} 07:26:04.892372 --- ParallelTerminationStrategy: PID 22568 died... 07:26:04.911031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22568): Terminated: ok {rc=0} 07:26:04.996833 bus /sierra_3: Setting Powered False 07:26:06.097467 bus /sierra_3: Setting Powered False 07:26:07.214396 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:26:08.361262 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:26:08.373312 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:26:08.442881 tst mo_mt_call_osmux.py: using LAC 39338 07:26:08.567764 tst mo_mt_call_osmux.py: using RAC 68 07:26:08.688863 tst mo_mt_call_osmux.py: using CellId 39338 07:26:08.811217 tst mo_mt_call_osmux.py: using BVCI 39339 07:26:08.925081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:26:08.936395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:26:08.947407 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:26:08.958441 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:26:08.969546 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:26:08.980615 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:26:09.099023 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:26:09.220818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:09.733367 run create_hlr_db(pid=22572): Launched 07:26:09.859793 bus /sierra_2: Setting Powered False 07:26:10.925056 run create_hlr_db(pid=22572): Terminated: ok {rc=0} 07:26:11.383611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22574): Launched 07:26:11.715076 run osmo-hlr_10.42.42.2(pid=22575): Launched 07:26:11.842693 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:12.412315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22577): Launched 07:26:12.744378 run osmo-stp_10.42.42.5(pid=22578): Launched 07:26:12.871621 run osmo-msc_10.42.42.6: Starting osmo-msc 07:26:13.469905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22580): Launched 07:26:13.802306 run osmo-msc_10.42.42.6(pid=22581): Launched 07:26:13.987737 run osmo-stp_10.42.42.5(pid=22578): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22578)] 07:26:14.127070 run osmo-stp_10.42.42.5(pid=22578): stdout: | (launched: 2022-12-14_07:26:12.683373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:14.267569 run osmo-stp_10.42.42.5(pid=22578): stderr: | 20221214072612875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072612875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072612876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072612876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072612877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072612877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072612877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:14.406090 run osmo-stp_10.42.42.5(pid=22578): stdout: | (launched: 2022-12-14_07:26:12.683373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:14.537132 run osmo-stp_10.42.42.5(pid=22578): stderr: | 20221214072612875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072612875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072612876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072612876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072612877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072612877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072612877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:14.694247 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22578): Process ended prematurely: osmo-stp_10.42.42.5(pid=22578) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22578)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:26:14.703983 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:26:14.731599 run osmo-hlr_10.42.42.2(pid=22575): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22575)] 07:26:14.782364 run osmo-hlr_10.42.42.2(pid=22575): stdout: | (launched: 2022-12-14_07:26:11.654432) 07:26:14.834664 run osmo-hlr_10.42.42.2(pid=22575): stderr: | 20221214072611851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072611851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072611851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072611851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072611852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072611852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072611864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072611872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072611873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072611873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:14.907637 run osmo-msc_10.42.42.6(pid=22581): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22581)] 07:26:14.957470 run osmo-msc_10.42.42.6(pid=22581): stdout: | (launched: 2022-12-14_07:26:13.741363) 07:26:15.009317 run osmo-msc_10.42.42.6(pid=22581): stderr: | 20221214072614063 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072614063 DLGLOBAL DEBUG validating counter group 0x7f25a684ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072614063 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072614063 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072614063 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072614063 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072614066 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072614066 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072614066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072614066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:15.061348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22574): Terminating (SIGTERM) 07:26:15.103421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22577): Terminating (SIGTERM) 07:26:15.145589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22580): Terminating (SIGTERM) 07:26:15.187761 --- ParallelTerminationStrategy: PID 22574 died... 07:26:15.208030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22574): Terminated: ok {rc=0} 07:26:15.254661 --- ParallelTerminationStrategy: PID 22577 died... 07:26:15.274574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22577): Terminated: ok {rc=0} 07:26:15.320912 --- ParallelTerminationStrategy: PID 22580 died... 07:26:15.340678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22580): Terminated: ok {rc=0} 07:26:15.428814 bus /sierra_3: Setting Powered False 07:26:16.526615 bus /sierra_3: Setting Powered False 07:26:17.642734 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:26:18.890642 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:26:18.897184 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:26:18.930690 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:26:18.957528 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:26:19.009803 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:26:19.043025 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:26:19.069249 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:26:19.620299 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:26:19.676381 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:19.688525 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:26:19.761248 tst mo_mt_call.py: using LAC 39339 07:26:19.889271 tst mo_mt_call.py: using RAC 69 07:26:20.018476 tst mo_mt_call.py: using CellId 39339 07:26:20.148030 tst mo_mt_call.py: using BVCI 39340 07:26:20.269255 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:20.281284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:20.292914 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:20.304699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:20.317109 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:20.329286 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:26:20.449899 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:26:20.572713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:21.085492 run create_hlr_db(pid=22586): Launched 07:26:21.213656 bus /sierra_2: Setting Powered False 07:26:22.279428 run create_hlr_db(pid=22586): Terminated: ok {rc=0} 07:26:22.720691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22588): Launched 07:26:23.029886 run osmo-hlr_10.42.42.2(pid=22589): Launched 07:26:23.150209 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:23.695926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22591): Launched 07:26:24.004659 run osmo-stp_10.42.42.5(pid=22592): Launched 07:26:24.121583 run osmo-msc_10.42.42.6: Starting osmo-msc 07:26:24.678714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22594): Launched 07:26:24.990317 run osmo-msc_10.42.42.6(pid=22595): Launched 07:26:25.165160 run osmo-stp_10.42.42.5(pid=22592): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22592)] 07:26:25.296756 run osmo-stp_10.42.42.5(pid=22592): stdout: | (launched: 2022-12-14_07:26:23.947532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:25.426962 run osmo-stp_10.42.42.5(pid=22592): stderr: | 20221214072624117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072624117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072624118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072624118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072624119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072624119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072624119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:25.555369 run osmo-stp_10.42.42.5(pid=22592): stdout: | (launched: 2022-12-14_07:26:23.947532) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:25.677215 run osmo-stp_10.42.42.5(pid=22592): stderr: | 20221214072624117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072624117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072624118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072624118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072624119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072624119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072624119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:25.823706 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22592): Process ended prematurely: osmo-stp_10.42.42.5(pid=22592) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22592)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:26:25.832688 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:26:25.858914 run osmo-hlr_10.42.42.2(pid=22589): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22589)] 07:26:25.906351 run osmo-hlr_10.42.42.2(pid=22589): stdout: | (launched: 2022-12-14_07:26:22.972299) 07:26:25.955722 run osmo-hlr_10.42.42.2(pid=22589): stderr: | 20221214072623146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072623146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072623147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072623147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072623147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072623147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072623160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072623168 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072623168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072623168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:26.024526 run osmo-msc_10.42.42.6(pid=22595): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22595)] 07:26:26.072267 run osmo-msc_10.42.42.6(pid=22595): stdout: | (launched: 2022-12-14_07:26:24.932409) 07:26:26.121485 run osmo-msc_10.42.42.6(pid=22595): stderr: | 20221214072625203 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072625203 DLGLOBAL DEBUG validating counter group 0x7f77cbb07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072625203 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072625203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072625203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072625203 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072625205 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072625206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072625206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072625206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:26.171116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22588): Terminating (SIGTERM) 07:26:26.210502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22591): Terminating (SIGTERM) 07:26:26.250272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22594): Terminating (SIGTERM) 07:26:26.290627 --- ParallelTerminationStrategy: PID 22588 died... 07:26:26.309671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22588): Terminated: ok {rc=0} 07:26:26.353427 --- ParallelTerminationStrategy: PID 22591 died... 07:26:26.371761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22591): Terminated: ok {rc=0} 07:26:26.415475 --- ParallelTerminationStrategy: PID 22594 died... 07:26:26.433904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22594): Terminated: ok {rc=0} 07:26:26.519424 bus /sierra_3: Setting Powered False 07:26:27.619391 bus /sierra_3: Setting Powered False 07:26:28.733931 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:26:29.883699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:29.896408 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:26:29.969558 tst mo_mt_call_osmux.py: using LAC 39340 07:26:30.101365 tst mo_mt_call_osmux.py: using RAC 70 07:26:30.232661 tst mo_mt_call_osmux.py: using CellId 39340 07:26:30.363375 tst mo_mt_call_osmux.py: using BVCI 39341 07:26:30.484167 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:30.496035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:30.507577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:30.519126 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:30.531333 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:26:30.543202 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:26:30.663557 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:26:30.780861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:31.333683 run create_hlr_db(pid=22597): Launched 07:26:31.501194 bus /sierra_2: Setting Powered False 07:26:32.565827 run create_hlr_db(pid=22597): Terminated: ok {rc=0} 07:26:33.034343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22599): Launched 07:26:33.344565 run osmo-hlr_10.42.42.2(pid=22600): Launched 07:26:33.463827 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:34.002622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22602): Launched 07:26:34.311908 run osmo-stp_10.42.42.5(pid=22603): Launched 07:26:34.429562 run osmo-msc_10.42.42.6: Starting osmo-msc 07:26:34.986423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22605): Launched 07:26:35.298519 run osmo-msc_10.42.42.6(pid=22606): Launched 07:26:35.474251 run osmo-stp_10.42.42.5(pid=22603): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22603)] 07:26:35.604888 run osmo-stp_10.42.42.5(pid=22603): stdout: | (launched: 2022-12-14_07:26:34.254399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:35.735333 run osmo-stp_10.42.42.5(pid=22603): stderr: | 20221214072634423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072634423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072634423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072634424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072634424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072634424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072634424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:35.863693 run osmo-stp_10.42.42.5(pid=22603): stdout: | (launched: 2022-12-14_07:26:34.254399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:35.985902 run osmo-stp_10.42.42.5(pid=22603): stderr: | 20221214072634423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072634423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072634423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072634424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072634424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072634424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072634424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:36.132739 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22603): Process ended prematurely: osmo-stp_10.42.42.5(pid=22603) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22603)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:26:36.141792 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:26:36.167945 run osmo-hlr_10.42.42.2(pid=22600): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22600)] 07:26:36.215606 run osmo-hlr_10.42.42.2(pid=22600): stdout: | (launched: 2022-12-14_07:26:33.286878) 07:26:36.265090 run osmo-hlr_10.42.42.2(pid=22600): stderr: | 20221214072633461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072633461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072633461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072633461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072633461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072633462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072633474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072633482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072633482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072633482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:36.334466 run osmo-msc_10.42.42.6(pid=22606): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22606)] 07:26:36.382308 run osmo-msc_10.42.42.6(pid=22606): stdout: | (launched: 2022-12-14_07:26:35.240592) 07:26:36.431308 run osmo-msc_10.42.42.6(pid=22606): stderr: | 20221214072635511 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072635511 DLGLOBAL DEBUG validating counter group 0x7f2c4b6d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072635511 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072635511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072635511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072635511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072635513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072635514 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072635514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072635514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:36.480812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22599): Terminating (SIGTERM) 07:26:36.520346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22602): Terminating (SIGTERM) 07:26:36.559984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22605): Terminating (SIGTERM) 07:26:36.599751 --- ParallelTerminationStrategy: PID 22599 died... 07:26:36.618841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22599): Terminated: ok {rc=0} 07:26:36.662647 --- ParallelTerminationStrategy: PID 22602 died... 07:26:36.681561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22602): Terminated: ok {rc=0} 07:26:36.725183 --- ParallelTerminationStrategy: PID 22605 died... 07:26:36.743604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22605): Terminated: ok {rc=0} 07:26:36.828772 bus /sierra_3: Setting Powered False 07:26:37.929045 bus /sierra_3: Setting Powered False 07:26:39.046689 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:26:40.302696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:26:40.310399 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:26:40.346329 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:26:40.374571 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:26:40.428196 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:26:40.462524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:26:40.490440 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:26:41.050793 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:26:41.106816 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:41.118490 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:26:41.190439 tst mo_mt_call.py: using LAC 39341 07:26:41.311336 tst mo_mt_call.py: using RAC 71 07:26:41.432048 tst mo_mt_call.py: using CellId 39341 07:26:41.552064 tst mo_mt_call.py: using BVCI 39342 07:26:41.664856 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:41.676296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:41.687776 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:41.699016 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:41.710302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:41.721412 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:26:41.842774 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:26:41.965053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:42.476502 run create_hlr_db(pid=22611): Launched 07:26:42.604610 bus /sierra_2: Setting Powered False 07:26:43.669264 run create_hlr_db(pid=22611): Terminated: ok {rc=0} 07:26:44.107764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22613): Launched 07:26:44.417600 run osmo-hlr_10.42.42.2(pid=22614): Launched 07:26:44.536311 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:45.070008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22616): Launched 07:26:45.378655 run osmo-stp_10.42.42.5(pid=22617): Launched 07:26:45.495361 run osmo-msc_10.42.42.6: Starting osmo-msc 07:26:46.072476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22619): Launched 07:26:46.438953 run osmo-msc_10.42.42.6(pid=22620): Launched 07:26:46.825222 run osmo-stp_10.42.42.5(pid=22617): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22617)] 07:26:47.074279 run osmo-stp_10.42.42.5(pid=22617): stdout: | (launched: 2022-12-14_07:26:45.321136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:47.206874 run osmo-stp_10.42.42.5(pid=22617): stderr: | 20221214072645492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072645492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072645492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072645493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072645493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072645493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072645493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:47.338357 run osmo-stp_10.42.42.5(pid=22617): stdout: | (launched: 2022-12-14_07:26:45.321136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:47.468477 run osmo-stp_10.42.42.5(pid=22617): stderr: | 20221214072645492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072645492 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072645492 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072645493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072645493 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072645493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072645493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:47.626400 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22617): Process ended prematurely: osmo-stp_10.42.42.5(pid=22617) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22617)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:26:47.636153 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:26:47.663903 run osmo-hlr_10.42.42.2(pid=22614): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22614)] 07:26:47.715767 run osmo-hlr_10.42.42.2(pid=22614): stdout: | (launched: 2022-12-14_07:26:44.359866) 07:26:47.767756 run osmo-hlr_10.42.42.2(pid=22614): stderr: | 20221214072644535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072644536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072644536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072644536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072644536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072644536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072644550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072644561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072644561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072644561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:47.841586 run osmo-msc_10.42.42.6(pid=22620): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22620)] 07:26:47.891247 run osmo-msc_10.42.42.6(pid=22620): stdout: | (launched: 2022-12-14_07:26:46.376331) 07:26:47.943328 run osmo-msc_10.42.42.6(pid=22620): stderr: | 20221214072646861 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072646861 DLGLOBAL DEBUG validating counter group 0x7f39a77f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072646861 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072646861 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072646862 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072646862 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072646863 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072646864 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072646864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072646864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:47.996028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22613): Terminating (SIGTERM) 07:26:48.038463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22616): Terminating (SIGTERM) 07:26:48.081024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22619): Terminating (SIGTERM) 07:26:48.123811 --- ParallelTerminationStrategy: PID 22613 died... 07:26:48.144634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22613): Terminated: ok {rc=0} 07:26:48.191227 --- ParallelTerminationStrategy: PID 22616 died... 07:26:48.211423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22616): Terminated: ok {rc=0} 07:26:48.257865 --- ParallelTerminationStrategy: PID 22619 died... 07:26:48.277935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22619): Terminated: ok {rc=0} 07:26:48.366485 bus /sierra_3: Setting Powered False 07:26:49.464340 bus /sierra_3: Setting Powered False 07:26:50.580896 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:26:51.731062 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:51.744014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:26:51.816212 tst mo_mt_call_osmux.py: using LAC 39342 07:26:51.947383 tst mo_mt_call_osmux.py: using RAC 72 07:26:52.077621 tst mo_mt_call_osmux.py: using CellId 39342 07:26:52.200101 tst mo_mt_call_osmux.py: using BVCI 39343 07:26:52.315290 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:52.326831 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:52.338042 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:52.349368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:52.360305 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:26:52.371286 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:26:52.492131 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:26:52.612131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:53.089485 run create_hlr_db(pid=22622): Launched 07:26:53.216084 bus /sierra_2: Setting Powered False 07:26:54.278153 run create_hlr_db(pid=22622): Terminated: ok {rc=0} 07:26:54.730741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22624): Launched 07:26:55.063743 run osmo-hlr_10.42.42.2(pid=22625): Launched 07:26:55.191450 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:55.762426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22627): Launched 07:26:56.094902 run osmo-stp_10.42.42.5(pid=22628): Launched 07:26:56.222228 run osmo-msc_10.42.42.6: Starting osmo-msc 07:26:56.821872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22630): Launched 07:26:57.152375 run osmo-msc_10.42.42.6(pid=22631): Launched 07:26:57.339832 run osmo-stp_10.42.42.5(pid=22628): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22628)] 07:26:57.483521 run osmo-stp_10.42.42.5(pid=22628): stdout: | (launched: 2022-12-14_07:26:56.033787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:57.623447 run osmo-stp_10.42.42.5(pid=22628): stderr: | 20221214072656225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072656225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072656225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072656226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072656226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072656226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072656226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:57.762349 run osmo-stp_10.42.42.5(pid=22628): stdout: | (launched: 2022-12-14_07:26:56.033787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:57.894755 run osmo-stp_10.42.42.5(pid=22628): stderr: | 20221214072656225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072656225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072656225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072656226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072656226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072656226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072656226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:58.053382 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22628): Process ended prematurely: osmo-stp_10.42.42.5(pid=22628) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22628)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:26:58.063350 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:26:58.091267 run osmo-hlr_10.42.42.2(pid=22625): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22625)] 07:26:58.142598 run osmo-hlr_10.42.42.2(pid=22625): stdout: | (launched: 2022-12-14_07:26:55.002710) 07:26:58.194880 run osmo-hlr_10.42.42.2(pid=22625): stderr: | 20221214072655201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072655201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072655201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072655201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072655201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072655201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072655213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072655222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072655223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072655223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:58.267340 run osmo-msc_10.42.42.6(pid=22631): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22631)] 07:26:58.317590 run osmo-msc_10.42.42.6(pid=22631): stdout: | (launched: 2022-12-14_07:26:57.091599) 07:26:58.369676 run osmo-msc_10.42.42.6(pid=22631): stderr: | 20221214072657412 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072657412 DLGLOBAL DEBUG validating counter group 0x7fd7fac88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072657412 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072657412 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072657413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072657413 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072657415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072657415 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072657415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072657415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:26:58.422011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22624): Terminating (SIGTERM) 07:26:58.464322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22627): Terminating (SIGTERM) 07:26:58.506444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22630): Terminating (SIGTERM) 07:26:58.548793 --- ParallelTerminationStrategy: PID 22624 died... 07:26:58.569199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22624): Terminated: ok {rc=0} 07:26:58.615695 --- ParallelTerminationStrategy: PID 22627 died... 07:26:58.635645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22627): Terminated: ok {rc=0} 07:26:58.682322 --- ParallelTerminationStrategy: PID 22630 died... 07:26:58.702068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22630): Terminated: ok {rc=0} 07:26:58.790682 bus /sierra_3: Setting Powered False 07:26:59.888471 bus /sierra_3: Setting Powered False 07:27:01.011486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:27:02.276103 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:27:02.283824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:27:02.319164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:27:02.346754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:27:02.401650 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:27:02.436605 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:27:02.464461 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:27:03.012441 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:27:03.067931 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:03.079839 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:27:03.152495 tst mo_mt_call.py: using LAC 39343 07:27:03.284126 tst mo_mt_call.py: using RAC 73 07:27:03.419188 tst mo_mt_call.py: using CellId 39343 07:27:03.555016 tst mo_mt_call.py: using BVCI 39344 07:27:03.677181 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:03.688817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:03.700316 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:03.711891 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:03.723479 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:03.735260 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:27:03.854812 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:27:03.978037 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:04.492691 run create_hlr_db(pid=22636): Launched 07:27:04.621368 bus /sierra_2: Setting Powered False 07:27:05.686727 run create_hlr_db(pid=22636): Terminated: ok {rc=0} 07:27:06.129111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Launched 07:27:06.439859 run osmo-hlr_10.42.42.2(pid=22639): Launched 07:27:06.558617 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:07.093093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22641): Launched 07:27:07.402323 run osmo-stp_10.42.42.5(pid=22642): Launched 07:27:07.521305 run osmo-msc_10.42.42.6: Starting osmo-msc 07:27:08.083725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22644): Launched 07:27:08.395352 run osmo-msc_10.42.42.6(pid=22645): Launched 07:27:08.570188 run osmo-stp_10.42.42.5(pid=22642): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22642)] 07:27:08.701420 run osmo-stp_10.42.42.5(pid=22642): stdout: | (launched: 2022-12-14_07:27:07.345149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:08.831608 run osmo-stp_10.42.42.5(pid=22642): stderr: | 20221214072707516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072707517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072707517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072707517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072707518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072707518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072707518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:08.960479 run osmo-stp_10.42.42.5(pid=22642): stdout: | (launched: 2022-12-14_07:27:07.345149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:09.082999 run osmo-stp_10.42.42.5(pid=22642): stderr: | 20221214072707516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072707517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072707517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072707517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072707518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072707518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072707518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:09.229912 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22642): Process ended prematurely: osmo-stp_10.42.42.5(pid=22642) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22642)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:27:09.238899 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:27:09.265227 run osmo-hlr_10.42.42.2(pid=22639): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22639)] 07:27:09.313183 run osmo-hlr_10.42.42.2(pid=22639): stdout: | (launched: 2022-12-14_07:27:06.382484) 07:27:09.362926 run osmo-hlr_10.42.42.2(pid=22639): stderr: | 20221214072706559 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072706559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072706559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072706559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072706559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072706559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072706571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072706579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072706580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072706580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:09.431677 run osmo-msc_10.42.42.6(pid=22645): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22645)] 07:27:09.479015 run osmo-msc_10.42.42.6(pid=22645): stdout: | (launched: 2022-12-14_07:27:08.337771) 07:27:09.527962 run osmo-msc_10.42.42.6(pid=22645): stderr: | 20221214072708612 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072708612 DLGLOBAL DEBUG validating counter group 0x7feb0a42fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072708612 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072708612 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072708612 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072708613 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072708614 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072708615 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072708615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072708615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:27:09.577299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Terminating (SIGTERM) 07:27:09.617204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22641): Terminating (SIGTERM) 07:27:09.657143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22644): Terminating (SIGTERM) 07:27:09.697419 --- ParallelTerminationStrategy: PID 22638 died... 07:27:09.716773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Terminated: ok {rc=0} 07:27:09.760774 --- ParallelTerminationStrategy: PID 22641 died... 07:27:09.779685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22641): Terminated: ok {rc=0} 07:27:09.823684 --- ParallelTerminationStrategy: PID 22644 died... 07:27:09.842547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22644): Terminated: ok {rc=0} 07:27:09.929319 bus /sierra_3: Setting Powered False 07:27:11.028558 bus /sierra_3: Setting Powered False 07:27:12.144694 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:27:13.290525 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:13.302785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:27:13.375779 tst mo_mt_call_osmux.py: using LAC 39344 07:27:13.497503 tst mo_mt_call_osmux.py: using RAC 74 07:27:13.618944 tst mo_mt_call_osmux.py: using CellId 39344 07:27:13.738808 tst mo_mt_call_osmux.py: using BVCI 39345 07:27:13.851682 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:13.863113 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:13.874285 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:13.885493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:13.897236 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:27:13.908826 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:27:14.033370 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:27:14.152096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:14.631752 run create_hlr_db(pid=22647): Launched 07:27:14.759500 bus /sierra_2: Setting Powered False 07:27:15.822058 run create_hlr_db(pid=22647): Terminated: ok {rc=0} 07:27:16.343574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22649): Launched 07:27:16.716282 run osmo-hlr_10.42.42.2(pid=22650): Launched 07:27:16.968803 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:17.615913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22652): Launched 07:27:17.951221 run osmo-stp_10.42.42.5(pid=22653): Launched 07:27:18.079432 run osmo-msc_10.42.42.6: Starting osmo-msc 07:27:18.680712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22655): Launched 07:27:19.015767 run osmo-msc_10.42.42.6(pid=22656): Launched 07:27:19.203090 run osmo-stp_10.42.42.5(pid=22653): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22653)] 07:27:19.344103 run osmo-stp_10.42.42.5(pid=22653): stdout: | (launched: 2022-12-14_07:27:17.890072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:19.485325 run osmo-stp_10.42.42.5(pid=22653): stderr: | 20221214072718081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072718082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072718082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072718082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072718083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072718083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072718083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:19.623682 run osmo-stp_10.42.42.5(pid=22653): stdout: | (launched: 2022-12-14_07:27:17.890072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:19.755655 run osmo-stp_10.42.42.5(pid=22653): stderr: | 20221214072718081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072718082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072718082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072718082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072718083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072718083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072718083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:19.913925 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22653): Process ended prematurely: osmo-stp_10.42.42.5(pid=22653) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22653)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:27:19.923891 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 07:27:19.951982 run osmo-hlr_10.42.42.2(pid=22650): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22650)] 07:27:20.003292 run osmo-hlr_10.42.42.2(pid=22650): stdout: | (launched: 2022-12-14_07:27:16.654330) 07:27:20.056327 run osmo-hlr_10.42.42.2(pid=22650): stderr: | 20221214072716959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072716959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072716959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072716959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072716959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072716959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072716975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072716987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072716987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072716988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:20.129391 run osmo-msc_10.42.42.6(pid=22656): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22656)] 07:27:20.179472 run osmo-msc_10.42.42.6(pid=22656): stdout: | (launched: 2022-12-14_07:27:18.954491) 07:27:20.231646 run osmo-msc_10.42.42.6(pid=22656): stderr: | 20221214072719275 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072719276 DLGLOBAL DEBUG validating counter group 0x7faaa7f15c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072719276 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072719276 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072719276 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072719276 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072719278 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072719278 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072719278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072719279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:27:20.284441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22649): Terminating (SIGTERM) 07:27:20.326771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22652): Terminating (SIGTERM) 07:27:20.369621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22655): Terminating (SIGTERM) 07:27:20.412328 --- ParallelTerminationStrategy: PID 22649 died... 07:27:20.433090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22649): Terminated: ok {rc=0} 07:27:20.479849 --- ParallelTerminationStrategy: PID 22652 died... 07:27:20.499932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22652): Terminated: ok {rc=0} 07:27:20.546519 --- ParallelTerminationStrategy: PID 22655 died... 07:27:20.566719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22655): Terminated: ok {rc=0} 07:27:20.657115 bus /sierra_3: Setting Powered False 07:27:21.756378 bus /sierra_3: Setting Powered False 07:27:22.874623 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:27:24.137258 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:27:24.144550 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:27:24.179838 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:27:24.207576 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:27:24.263546 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:27:24.299011 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:27:24.326589 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:27:24.871684 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:27:24.920389 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:24.931841 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:27:25.004373 tst mo_mt_call.py: using LAC 39345 07:27:25.129441 tst mo_mt_call.py: using RAC 75 07:27:25.249551 tst mo_mt_call.py: using CellId 39345 07:27:25.378729 tst mo_mt_call.py: using BVCI 39346 07:27:25.500488 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:25.512571 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:25.524351 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:25.536214 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:25.548508 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:25.560677 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:27:25.678652 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:27:25.802893 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:26.315155 run create_hlr_db(pid=22662): Launched 07:27:26.441078 bus /sierra_2: Setting Powered False 07:27:27.506056 run create_hlr_db(pid=22662): Terminated: ok {rc=0} 07:27:27.947636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22664): Launched 07:27:28.259501 run osmo-hlr_10.42.42.2(pid=22665): Launched 07:27:28.377172 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:28.924199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22667): Launched 07:27:29.233694 run osmo-stp_10.42.42.5(pid=22668): Launched 07:27:29.351516 run osmo-msc_10.42.42.6: Starting osmo-msc 07:27:29.910024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22670): Launched 07:27:30.219469 run osmo-msc_10.42.42.6(pid=22671): Launched 07:27:30.391892 run osmo-stp_10.42.42.5(pid=22668): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22668)] 07:27:30.522231 run osmo-stp_10.42.42.5(pid=22668): stdout: | (launched: 2022-12-14_07:27:29.176397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:30.652011 run osmo-stp_10.42.42.5(pid=22668): stderr: | 20221214072729347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072729347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072729347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072729348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072729348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072729348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072729349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:30.780509 run osmo-stp_10.42.42.5(pid=22668): stdout: | (launched: 2022-12-14_07:27:29.176397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:30.937310 run osmo-stp_10.42.42.5(pid=22668): stderr: | 20221214072729347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072729347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072729347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072729348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072729348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072729348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072729349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:31.087148 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22668): Process ended prematurely: osmo-stp_10.42.42.5(pid=22668) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22668)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:27:31.097351 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:27:31.124890 run osmo-hlr_10.42.42.2(pid=22665): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22665)] 07:27:31.174506 run osmo-hlr_10.42.42.2(pid=22665): stdout: | (launched: 2022-12-14_07:27:28.202370) 07:27:31.224866 run osmo-hlr_10.42.42.2(pid=22665): stderr: | 20221214072728376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072728376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072728376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072728376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072728376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072728377 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072728389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072728397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072728397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072728397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:31.295199 run osmo-msc_10.42.42.6(pid=22671): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22671)] 07:27:31.343643 run osmo-msc_10.42.42.6(pid=22671): stdout: | (launched: 2022-12-14_07:27:30.162069) 07:27:31.394409 run osmo-msc_10.42.42.6(pid=22671): stderr: | 20221214072730431 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072730431 DLGLOBAL DEBUG validating counter group 0x7f795abb1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072730432 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072730432 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072730432 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072730432 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072730434 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072730434 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072730434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072730434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:27:31.445601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22664): Terminating (SIGTERM) 07:27:31.486639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22667): Terminating (SIGTERM) 07:27:31.527834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22670): Terminating (SIGTERM) 07:27:31.570998 --- ParallelTerminationStrategy: PID 22664 died... 07:27:31.590821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22664): Terminated: ok {rc=0} 07:27:31.637546 --- ParallelTerminationStrategy: PID 22667 died... 07:27:31.656706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22667): Terminated: ok {rc=0} 07:27:31.701662 --- ParallelTerminationStrategy: PID 22670 died... 07:27:31.720822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22670): Terminated: ok {rc=0} 07:27:31.805886 bus /sierra_3: Setting Powered False 07:27:32.902504 bus /sierra_3: Setting Powered False 07:27:34.019091 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:27:35.169623 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:35.182422 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:27:35.255518 tst mo_mt_call_osmux.py: using LAC 39346 07:27:35.387348 tst mo_mt_call_osmux.py: using RAC 76 07:27:35.519153 tst mo_mt_call_osmux.py: using CellId 39346 07:27:35.650523 tst mo_mt_call_osmux.py: using BVCI 39347 07:27:35.763529 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:35.775194 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:35.786430 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:35.797909 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:35.809844 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:27:35.821795 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:27:35.945752 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:27:36.068770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:36.582503 run create_hlr_db(pid=22673): Launched 07:27:36.710823 bus /sierra_2: Setting Powered False 07:27:37.773214 run create_hlr_db(pid=22673): Terminated: ok {rc=0} 07:27:38.214914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22675): Launched 07:27:38.524331 run osmo-hlr_10.42.42.2(pid=22676): Launched 07:27:38.642801 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:39.175963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22678): Launched 07:27:39.485633 run osmo-stp_10.42.42.5(pid=22679): Launched 07:27:39.605195 run osmo-msc_10.42.42.6: Starting osmo-msc 07:27:40.168055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22681): Launched 07:27:40.480692 run osmo-msc_10.42.42.6(pid=22682): Launched 07:27:40.653551 run osmo-stp_10.42.42.5(pid=22679): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22679)] 07:27:40.787693 run osmo-stp_10.42.42.5(pid=22679): stdout: | (launched: 2022-12-14_07:27:39.428057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:40.919118 run osmo-stp_10.42.42.5(pid=22679): stderr: | 20221214072739599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072739599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072739599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072739600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072739600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072739600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072739600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:41.047282 run osmo-stp_10.42.42.5(pid=22679): stdout: | (launched: 2022-12-14_07:27:39.428057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:41.169537 run osmo-stp_10.42.42.5(pid=22679): stderr: | 20221214072739599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072739599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072739599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072739600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072739600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072739600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072739600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:41.316225 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22679): Process ended prematurely: osmo-stp_10.42.42.5(pid=22679) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22679)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:27:41.325400 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:27:41.351888 run osmo-hlr_10.42.42.2(pid=22676): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22676)] 07:27:41.399521 run osmo-hlr_10.42.42.2(pid=22676): stdout: | (launched: 2022-12-14_07:27:38.467003) 07:27:41.449187 run osmo-hlr_10.42.42.2(pid=22676): stderr: | 20221214072738645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072738645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072738645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072738646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072738646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072738646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072738661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072738670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072738670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072738670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:41.518170 run osmo-msc_10.42.42.6(pid=22682): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22682)] 07:27:41.565759 run osmo-msc_10.42.42.6(pid=22682): stdout: | (launched: 2022-12-14_07:27:40.423127) 07:27:41.614953 run osmo-msc_10.42.42.6(pid=22682): stderr: | 20221214072740697 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072740697 DLGLOBAL DEBUG validating counter group 0x7ff1ab55cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072740697 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072740697 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072740697 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072740697 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072740699 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072740699 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072740700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072740700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:27:41.664598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22675): Terminating (SIGTERM) 07:27:41.704175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22678): Terminating (SIGTERM) 07:27:41.743822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22681): Terminating (SIGTERM) 07:27:41.783738 --- ParallelTerminationStrategy: PID 22675 died... 07:27:41.802980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22675): Terminated: ok {rc=0} 07:27:41.847052 --- ParallelTerminationStrategy: PID 22678 died... 07:27:41.865738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22678): Terminated: ok {rc=0} 07:27:41.909837 --- ParallelTerminationStrategy: PID 22681 died... 07:27:41.928456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22681): Terminated: ok {rc=0} 07:27:42.011547 bus /sierra_3: Setting Powered False 07:27:43.109946 bus /sierra_3: Setting Powered False 07:27:44.224752 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:27:45.480488 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:27:45.486831 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:27:45.521271 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:27:45.549611 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:27:45.604087 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:27:45.638777 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:27:45.667173 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:27:46.231954 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:27:46.309552 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:46.326653 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:27:46.418231 tst mo_mt_call.py: using LAC 39347 07:27:46.550513 tst mo_mt_call.py: using RAC 77 07:27:46.684070 tst mo_mt_call.py: using CellId 39347 07:27:46.805930 tst mo_mt_call.py: using BVCI 39348 07:27:46.932488 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:46.945267 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:46.957980 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:46.970660 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:46.984525 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:46.998224 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:27:47.127014 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:27:47.245427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:47.726517 run create_hlr_db(pid=22688): Launched 07:27:47.854461 bus /sierra_2: Setting Powered False 07:27:48.916428 run create_hlr_db(pid=22688): Terminated: ok {rc=0} 07:27:49.348639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22690): Launched 07:27:49.658535 run osmo-hlr_10.42.42.2(pid=22691): Launched 07:27:49.777144 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:50.307995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22693): Launched 07:27:50.642384 run osmo-stp_10.42.42.5(pid=22694): Launched 07:27:50.770718 run osmo-msc_10.42.42.6: Starting osmo-msc 07:27:51.372685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22696): Launched 07:27:51.706049 run osmo-msc_10.42.42.6(pid=22697): Launched 07:27:51.892514 run osmo-stp_10.42.42.5(pid=22694): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22694)] 07:27:52.032471 run osmo-stp_10.42.42.5(pid=22694): stdout: | (launched: 2022-12-14_07:27:50.581069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:52.173387 run osmo-stp_10.42.42.5(pid=22694): stderr: | 20221214072750775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072750775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072750775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072750775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072750776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072750776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072750776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:52.313184 run osmo-stp_10.42.42.5(pid=22694): stdout: | (launched: 2022-12-14_07:27:50.581069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:52.445784 run osmo-stp_10.42.42.5(pid=22694): stderr: | 20221214072750775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072750775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072750775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072750775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072750776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072750776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072750776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:52.604343 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22694): Process ended prematurely: osmo-stp_10.42.42.5(pid=22694) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22694)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:27:52.614406 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:27:52.642332 run osmo-hlr_10.42.42.2(pid=22691): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22691)] 07:27:52.694291 run osmo-hlr_10.42.42.2(pid=22691): stdout: | (launched: 2022-12-14_07:27:49.601125) 07:27:52.747213 run osmo-hlr_10.42.42.2(pid=22691): stderr: | 20221214072749774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072749774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072749775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072749775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072749775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072749775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072749787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072749797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072749797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072749797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:52.819930 run osmo-msc_10.42.42.6(pid=22697): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22697)] 07:27:52.869805 run osmo-msc_10.42.42.6(pid=22697): stdout: | (launched: 2022-12-14_07:27:51.644627) 07:27:52.922184 run osmo-msc_10.42.42.6(pid=22697): stderr: | 20221214072751966 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072751966 DLGLOBAL DEBUG validating counter group 0x7f3b32913c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072751966 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072751966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072751966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072751967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072751968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072751969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072751969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072751969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:27:52.974547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22690): Terminating (SIGTERM) 07:27:53.016403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22693): Terminating (SIGTERM) 07:27:53.058847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22696): Terminating (SIGTERM) 07:27:53.101414 --- ParallelTerminationStrategy: PID 22690 died... 07:27:53.121960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22690): Terminated: ok {rc=0} 07:27:53.168748 --- ParallelTerminationStrategy: PID 22693 died... 07:27:53.188790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22693): Terminated: ok {rc=0} 07:27:53.235407 --- ParallelTerminationStrategy: PID 22696 died... 07:27:53.255592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22696): Terminated: ok {rc=0} 07:27:53.345111 bus /sierra_3: Setting Powered False 07:27:54.445178 bus /sierra_3: Setting Powered False 07:27:55.562821 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:27:56.714052 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:56.726685 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:27:56.800841 tst mo_mt_call_osmux.py: using LAC 39348 07:27:56.932282 tst mo_mt_call_osmux.py: using RAC 78 07:27:57.063228 tst mo_mt_call_osmux.py: using CellId 39348 07:27:57.195219 tst mo_mt_call_osmux.py: using BVCI 39349 07:27:57.329413 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:57.340807 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:57.352021 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:57.363407 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:57.375223 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:27:57.386835 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:27:57.505325 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:27:57.630659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:58.127387 run create_hlr_db(pid=22699): Launched 07:27:58.249465 bus /sierra_2: Setting Powered False 07:27:59.312768 run create_hlr_db(pid=22699): Terminated: ok {rc=0} 07:27:59.759268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22701): Launched 07:28:00.080731 run osmo-hlr_10.42.42.2(pid=22702): Launched 07:28:00.202476 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:00.758071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22704): Launched 07:28:01.094921 run osmo-stp_10.42.42.5(pid=22705): Launched 07:28:01.336651 run osmo-msc_10.42.42.6: Starting osmo-msc 07:28:01.954892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22707): Launched 07:28:02.272592 run osmo-msc_10.42.42.6(pid=22708): Launched 07:28:02.452535 run osmo-stp_10.42.42.5(pid=22705): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22705)] 07:28:02.588913 run osmo-stp_10.42.42.5(pid=22705): stdout: | (launched: 2022-12-14_07:28:01.033618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:02.725735 run osmo-stp_10.42.42.5(pid=22705): stderr: | 20221214072801350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072801350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072801350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072801350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072801351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072801351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072801351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:02.860488 run osmo-stp_10.42.42.5(pid=22705): stdout: | (launched: 2022-12-14_07:28:01.033618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:02.988388 run osmo-stp_10.42.42.5(pid=22705): stderr: | 20221214072801350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072801350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072801350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072801350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072801351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072801351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072801351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:03.142323 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22705): Process ended prematurely: osmo-stp_10.42.42.5(pid=22705) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22705)] [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:28:03.151966 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:28:03.179459 run osmo-hlr_10.42.42.2(pid=22702): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22702)] 07:28:03.229733 run osmo-hlr_10.42.42.2(pid=22702): stdout: | (launched: 2022-12-14_07:28:00.021911) 07:28:03.281320 run osmo-hlr_10.42.42.2(pid=22702): stderr: | 20221214072800214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072800214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072800215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072800215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072800215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072800215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072800231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072800240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072800240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072800240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:03.353584 run osmo-msc_10.42.42.6(pid=22708): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22708)] 07:28:03.403264 run osmo-msc_10.42.42.6(pid=22708): stdout: | (launched: 2022-12-14_07:28:02.214058) 07:28:03.454689 run osmo-msc_10.42.42.6(pid=22708): stderr: | 20221214072802528 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072802529 DLGLOBAL DEBUG validating counter group 0x7fe862f43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072802529 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072802529 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072802529 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072802529 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072802531 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072802531 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072802531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072802531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:28:03.506988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22701): Terminating (SIGTERM) 07:28:03.548404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22704): Terminating (SIGTERM) 07:28:03.590591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22707): Terminating (SIGTERM) 07:28:03.632575 --- ParallelTerminationStrategy: PID 22701 died... 07:28:03.652882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22701): Terminated: ok {rc=0} 07:28:03.699153 --- ParallelTerminationStrategy: PID 22704 died... 07:28:03.718847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22704): Terminated: ok {rc=0} 07:28:03.764701 --- ParallelTerminationStrategy: PID 22707 died... 07:28:03.784468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22707): Terminated: ok {rc=0} 07:28:03.871666 bus /sierra_3: Setting Powered False 07:28:04.969716 bus /sierra_3: Setting Powered False 07:28:06.088343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 07:28:07.338901 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:28:07.343557 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:28:07.377929 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 07:28:07.405816 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 07:28:07.500636 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:28:07.534714 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 07:28:07.561957 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 07:28:08.142773 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2401 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 07:28:08.148018 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:08.159179 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:28:08.209491 tst emergency_mo_mt_call.py: using LAC 39349 07:28:08.325609 tst emergency_mo_mt_call.py: using RAC 79 07:28:08.450925 tst emergency_mo_mt_call.py: using CellId 39349 07:28:08.572273 tst emergency_mo_mt_call.py: using BVCI 39350 07:28:08.686386 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:08.697831 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:08.708929 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:08.720153 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:08.731635 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:08.743001 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:08.859488 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:08.975542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:09.430568 run create_hlr_db(pid=22713): Launched 07:28:09.554556 bus /sierra_2: Setting Powered False 07:28:10.618000 run create_hlr_db(pid=22713): Terminated: ok {rc=0} 07:28:11.067762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22715): Launched 07:28:11.387958 run osmo-hlr_10.42.42.2(pid=22716): Launched 07:28:11.509928 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:12.062208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22718): Launched 07:28:12.382833 run osmo-stp_10.42.42.5(pid=22719): Launched 07:28:12.514285 tst emergency_mo_mt_call.py: using MSISDN 8566 07:28:12.677367 run osmo-msc_10.42.42.6: Starting osmo-msc 07:28:13.254485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22721): Launched 07:28:13.575218 run osmo-msc_10.42.42.6(pid=22722): Launched 07:28:13.753765 run osmo-stp_10.42.42.5(pid=22719): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22719)] 07:28:13.888702 run osmo-stp_10.42.42.5(pid=22719): stdout: | (launched: 2022-12-14_07:28:12.323767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:14.024156 run osmo-stp_10.42.42.5(pid=22719): stderr: | 20221214072812512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072812512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072812512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072812512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072812513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072812513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072812513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:14.157869 run osmo-stp_10.42.42.5(pid=22719): stdout: | (launched: 2022-12-14_07:28:12.323767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:14.285043 run osmo-stp_10.42.42.5(pid=22719): stderr: | 20221214072812512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072812512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072812512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072812512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072812513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072812513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072812513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:14.438097 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=22719): Process ended prematurely: osmo-stp_10.42.42.5(pid=22719) [trial-2401↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22719)] [trial-2401↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 07:28:14.447109 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 07:28:14.474152 run osmo-hlr_10.42.42.2(pid=22716): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22716)] 07:28:14.525121 run osmo-hlr_10.42.42.2(pid=22716): stdout: | (launched: 2022-12-14_07:28:11.329293) 07:28:14.577347 run osmo-hlr_10.42.42.2(pid=22716): stderr: | 20221214072811521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072811521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072811521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072811521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072811521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072811521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072811534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072811542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072811542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072811542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:14.649145 run osmo-msc_10.42.42.6(pid=22722): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22722)] 07:28:14.698762 run osmo-msc_10.42.42.6(pid=22722): stdout: | (launched: 2022-12-14_07:28:13.516301) 07:28:14.750515 run osmo-msc_10.42.42.6(pid=22722): stderr: | 20221214072813834 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072813834 DLGLOBAL DEBUG validating counter group 0x7f824722ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072813834 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072813834 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072813834 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072813834 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072813836 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072813836 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072813837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072813837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:28:14.802836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22715): Terminating (SIGTERM) 07:28:14.844500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22718): Terminating (SIGTERM) 07:28:14.886600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22721): Terminating (SIGTERM) 07:28:14.929273 --- ParallelTerminationStrategy: PID 22715 died... 07:28:14.949487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22715): Terminated: ok {rc=0} 07:28:14.995623 --- ParallelTerminationStrategy: PID 22718 died... 07:28:15.015403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22718): Terminated: ok {rc=0} 07:28:15.061471 --- ParallelTerminationStrategy: PID 22721 died... 07:28:15.081326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22721): Terminated: ok {rc=0} 07:28:15.168405 bus /sierra_3: Setting Powered False 07:28:16.264119 bus /sierra_3: Setting Powered False 07:28:17.377854 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 07:28:18.463903 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:18.476066 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:28:18.529371 tst emergency_preemptive_call.py: using LAC 39350 07:28:18.653903 tst emergency_preemptive_call.py: using RAC 80 07:28:18.779507 tst emergency_preemptive_call.py: using CellId 39350 07:28:18.903420 tst emergency_preemptive_call.py: using BVCI 39351 07:28:19.018473 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:19.029895 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:19.040893 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:19.051989 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:19.063438 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:28:19.074759 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:19.193108 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:19.311341 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:19.431295 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:19.546793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:20.007232 run create_hlr_db(pid=22724): Launched 07:28:20.129173 bus /sierra_2: Setting Powered False 07:28:21.189979 run create_hlr_db(pid=22724): Terminated: ok {rc=0} 07:28:21.629254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22726): Launched 07:28:21.951879 run osmo-hlr_10.42.42.2(pid=22727): Launched 07:28:22.073448 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:22.631683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22729): Launched 07:28:22.953293 run osmo-stp_10.42.42.5(pid=22730): Launched 07:28:23.084770 tst emergency_preemptive_call.py: using MSISDN 8567 07:28:23.250166 run osmo-msc_10.42.42.6: Starting osmo-msc 07:28:23.827151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22732): Launched 07:28:24.148447 run osmo-msc_10.42.42.6(pid=22733): Launched 07:28:24.326753 run osmo-stp_10.42.42.5(pid=22730): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22730)] 07:28:24.463912 run osmo-stp_10.42.42.5(pid=22730): stdout: | (launched: 2022-12-14_07:28:22.894159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:24.600450 run osmo-stp_10.42.42.5(pid=22730): stderr: | 20221214072823083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072823083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072823084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072823084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072823085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072823085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072823085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:24.734931 run osmo-stp_10.42.42.5(pid=22730): stdout: | (launched: 2022-12-14_07:28:22.894159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:24.862352 run osmo-stp_10.42.42.5(pid=22730): stderr: | 20221214072823083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072823083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072823084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072823084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072823085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072823085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072823085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:25.014943 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=22730): Process ended prematurely: osmo-stp_10.42.42.5(pid=22730) [trial-2401↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22730)] [trial-2401↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 07:28:25.023866 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 07:28:25.051095 run osmo-hlr_10.42.42.2(pid=22727): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22727)] 07:28:25.101809 run osmo-hlr_10.42.42.2(pid=22727): stdout: | (launched: 2022-12-14_07:28:21.892582) 07:28:25.153899 run osmo-hlr_10.42.42.2(pid=22727): stderr: | 20221214072822087 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072822087 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072822087 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072822087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072822087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072822087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072822099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072822109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072822109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072822110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:25.227216 run osmo-msc_10.42.42.6(pid=22733): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=22733)] 07:28:25.277448 run osmo-msc_10.42.42.6(pid=22733): stdout: | (launched: 2022-12-14_07:28:24.089203) 07:28:25.330439 run osmo-msc_10.42.42.6(pid=22733): stderr: | 20221214072824406 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214072824406 DLGLOBAL DEBUG validating counter group 0x7fe9a3e49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214072824406 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214072824406 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214072824406 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214072824406 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214072824408 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214072824409 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214072824409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214072824409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:28:25.382698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22726): Terminating (SIGTERM) 07:28:25.424654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22729): Terminating (SIGTERM) 07:28:25.467166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22732): Terminating (SIGTERM) 07:28:25.509575 --- ParallelTerminationStrategy: PID 22726 died... 07:28:25.529683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22726): Terminated: ok {rc=0} 07:28:25.576051 --- ParallelTerminationStrategy: PID 22729 died... 07:28:25.595818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22729): Terminated: ok {rc=0} 07:28:25.641846 --- ParallelTerminationStrategy: PID 22732 died... 07:28:25.661509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22732): Terminated: ok {rc=0} 07:28:25.750185 bus /sierra_9: Setting Powered False 07:28:26.849318 bus /sierra_9: Setting Powered False 07:28:27.969592 bus /sierra_8: Setting Powered False 07:28:29.066917 bus /sierra_8: Setting Powered False 07:28:30.179891 bus /sierra_3: Setting Powered False 07:28:31.285852 bus /sierra_3: Setting Powered False 07:28:32.420556 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 07:28:33.703485 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:28:33.707837 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:28:33.740906 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 07:28:33.779180 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 07:28:33.864774 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:28:33.897592 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 07:28:33.935074 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 07:28:34.533042 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 07:28:34.587085 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:34.598615 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:28:34.647510 tst cs_paging_gprs_active.py: using LAC 39351 07:28:34.775490 tst cs_paging_gprs_active.py: using RAC 81 07:28:34.903795 tst cs_paging_gprs_active.py: using CellId 39351 07:28:35.033417 tst cs_paging_gprs_active.py: using BVCI 39352 07:28:35.145457 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:35.156178 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:35.166905 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:35.177549 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:35.188470 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:35.199530 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:35.210957 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:35.221964 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:35.233387 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:35.351093 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:35.473157 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:28:35.695002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:36.023664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22738): Launched 07:28:36.309500 run iperf3-srv_10.42.42.10(pid=22739): Launched 07:28:36.434566 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:28:36.657291 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:36.988563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22740): Launched 07:28:37.274662 run iperf3-srv_10.42.42.10(pid=22741): Launched 07:28:37.399224 tst cs_paging_gprs_active.py:38: start network... 07:28:37.620557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:38.127758 run create_hlr_db(pid=22742): Launched 07:28:38.266315 bus /sierra_2: Setting Powered False 07:28:39.331347 run create_hlr_db(pid=22742): Terminated: ok {rc=0} 07:28:39.767611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22744): Launched 07:28:40.077393 run osmo-hlr_10.42.42.2(pid=22745): Launched 07:28:40.195321 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:40.741087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22747): Launched 07:28:41.050519 run osmo-stp_10.42.42.5(pid=22748): Launched 07:28:41.166951 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:41.698774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22750): Launched 07:28:41.816800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:42.077384 run patchelf(pid=22751): Launched 07:28:42.250935 run osmo-stp_10.42.42.5(pid=22748): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22748)] 07:28:42.382343 run osmo-stp_10.42.42.5(pid=22748): stdout: | (launched: 2022-12-14_07:28:40.992658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:42.514856 run osmo-stp_10.42.42.5(pid=22748): stderr: | 20221214072841161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072841161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072841162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072841162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072841162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072841162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072841163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:42.647462 run osmo-stp_10.42.42.5(pid=22748): stdout: | (launched: 2022-12-14_07:28:40.992658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:42.774689 run osmo-stp_10.42.42.5(pid=22748): stderr: | 20221214072841161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072841161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072841162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072841162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072841162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072841162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072841163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:42.925078 run patchelf(pid=22751): Terminating (SIGINT) 07:28:43.100613 run patchelf(pid=22751): Terminated: ok {rc=0} 07:28:43.227592 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22748): Process ended prematurely: osmo-stp_10.42.42.5(pid=22748) [trial-2401↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22748)] [trial-2401↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 07:28:43.237094 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:28:43.263815 run osmo-hlr_10.42.42.2(pid=22745): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22745)] 07:28:43.311428 run osmo-hlr_10.42.42.2(pid=22745): stdout: | (launched: 2022-12-14_07:28:40.020635) 07:28:43.360938 run osmo-hlr_10.42.42.2(pid=22745): stderr: | 20221214072840194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072840194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072840194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072840194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072840194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072840194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072840207 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072840215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072840215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072840215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:43.410676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22738): Terminating (SIGTERM) 07:28:43.450497 run iperf3-srv_10.42.42.10(pid=22739): Terminating (SIGTERM) 07:28:43.489927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22740): Terminating (SIGTERM) 07:28:43.529474 run iperf3-srv_10.42.42.10(pid=22741): Terminating (SIGTERM) 07:28:43.568878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22744): Terminating (SIGTERM) 07:28:43.608362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22747): Terminating (SIGTERM) 07:28:43.647829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22750): Terminating (SIGTERM) 07:28:43.687517 --- ParallelTerminationStrategy: PID 22738 died... 07:28:43.706611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22738): Terminated: ok {rc=0} 07:28:43.750358 --- ParallelTerminationStrategy: PID 22739 died... 07:28:43.768730 run iperf3-srv_10.42.42.10(pid=22739): Terminated {rc=256} 07:28:43.812058 --- ParallelTerminationStrategy: PID 22740 died... 07:28:43.830797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22740): Terminated: ok {rc=0} 07:28:43.874057 --- ParallelTerminationStrategy: PID 22741 died... 07:28:43.892510 run iperf3-srv_10.42.42.10(pid=22741): Terminated {rc=256} 07:28:43.935768 --- ParallelTerminationStrategy: PID 22744 died... 07:28:43.954260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22744): Terminated: ok {rc=0} 07:28:43.997443 --- ParallelTerminationStrategy: PID 22747 died... 07:28:44.015805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22747): Terminated: ok {rc=0} 07:28:44.059168 --- ParallelTerminationStrategy: PID 22750 died... 07:28:44.077772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22750): Terminated: ok {rc=0} 07:28:44.163169 bus /gobi_0: Setting Powered False 07:28:45.260911 bus /gobi_0: Setting Powered False 07:28:46.385508 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 07:28:47.547542 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:47.559070 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:28:47.612204 tst iperf3.py: using LAC 39352 07:28:47.734775 tst iperf3.py: using RAC 82 07:28:47.857218 tst iperf3.py: using CellId 39352 07:28:47.977511 tst iperf3.py: using BVCI 39353 07:28:48.099595 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:48.111191 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:48.122511 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:48.134136 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:48.146281 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:48.158334 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:48.170594 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:48.182430 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:48.194508 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:48.314387 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:28:48.522006 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:48.830117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22752): Launched 07:28:49.098369 run iperf3-srv_10.42.42.10(pid=22753): Launched 07:28:49.214265 tst iperf3.py:8: start network... 07:28:49.421258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:49.898033 run create_hlr_db(pid=22754): Launched 07:28:50.025222 bus /gobi_6: Setting Powered False 07:28:51.085952 run create_hlr_db(pid=22754): Terminated: ok {rc=0} 07:28:51.536803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22756): Launched 07:28:51.866874 run osmo-hlr_10.42.42.2(pid=22757): Launched 07:28:51.992656 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:52.564495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22759): Launched 07:28:52.894514 run osmo-stp_10.42.42.5(pid=22760): Launched 07:28:53.019924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:53.588103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22762): Launched 07:28:53.715642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:53.993885 run patchelf(pid=22763): Launched 07:28:54.178780 run osmo-stp_10.42.42.5(pid=22760): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22760)] 07:28:54.319036 run osmo-stp_10.42.42.5(pid=22760): stdout: | (launched: 2022-12-14_07:28:52.834622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:54.461191 run osmo-stp_10.42.42.5(pid=22760): stderr: | 20221214072853022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072853022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072853022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072853023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072853023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072853023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072853023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:54.603074 run osmo-stp_10.42.42.5(pid=22760): stdout: | (launched: 2022-12-14_07:28:52.834622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:54.738683 run osmo-stp_10.42.42.5(pid=22760): stderr: | 20221214072853022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072853022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072853022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072853023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072853023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072853023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072853023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:54.899105 run patchelf(pid=22763): Terminating (SIGINT) 07:28:55.085970 run patchelf(pid=22763): Terminated: ok {rc=0} 07:28:55.221054 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22760): Process ended prematurely: osmo-stp_10.42.42.5(pid=22760) [trial-2401↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22760)] [trial-2401↪gprs:trx-sysmocell5000↪iperf3.py:8] 07:28:55.231266 tst iperf3.py:8: Test FAILED (7.7 sec) 07:28:55.259699 run osmo-hlr_10.42.42.2(pid=22757): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22757)] 07:28:55.310608 run osmo-hlr_10.42.42.2(pid=22757): stdout: | (launched: 2022-12-14_07:28:51.806988) 07:28:55.363420 run osmo-hlr_10.42.42.2(pid=22757): stderr: | 20221214072852001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072852001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072852001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072852001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072852001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072852001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072852014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072852025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072852026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072852026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:55.416017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22752): Terminating (SIGTERM) 07:28:55.458559 run iperf3-srv_10.42.42.10(pid=22753): Terminating (SIGTERM) 07:28:55.500570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22756): Terminating (SIGTERM) 07:28:55.543003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22759): Terminating (SIGTERM) 07:28:55.585253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22762): Terminating (SIGTERM) 07:28:55.627631 --- ParallelTerminationStrategy: PID 22752 died... 07:28:55.647971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22752): Terminated: ok {rc=0} 07:28:55.694550 --- ParallelTerminationStrategy: PID 22753 died... 07:28:55.714383 run iperf3-srv_10.42.42.10(pid=22753): Terminated {rc=256} 07:28:55.760686 --- ParallelTerminationStrategy: PID 22756 died... 07:28:55.780620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22756): Terminated: ok {rc=0} 07:28:55.827157 --- ParallelTerminationStrategy: PID 22759 died... 07:28:55.847086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22759): Terminated: ok {rc=0} 07:28:55.893804 --- ParallelTerminationStrategy: PID 22762 died... 07:28:55.913759 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22762): Terminated: ok {rc=0} 07:28:56.002374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 07:28:57.149595 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:57.161584 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:28:57.211799 tst iperf3m4.py: using LAC 39353 07:28:57.332582 tst iperf3m4.py: using RAC 83 07:28:57.462217 tst iperf3m4.py: using CellId 39353 07:28:57.591902 tst iperf3m4.py: using BVCI 39354 07:28:57.711225 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:57.722595 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:57.733791 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:57.744690 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:57.755664 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:57.767029 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:57.778464 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:57.790071 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:28:57.801429 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:57.923558 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:58.044357 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:58.166560 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:28:58.285517 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:28:58.491946 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:58.800104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22764): Launched 07:28:59.068705 run iperf3-srv_10.42.42.10(pid=22765): Launched 07:28:59.184434 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:28:59.390733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:59.700422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22766): Launched 07:28:59.968708 run iperf3-srv_10.42.42.10(pid=22767): Launched 07:29:00.084823 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:29:00.290531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:00.598786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22768): Launched 07:29:00.871077 run iperf3-srv_10.42.42.10(pid=22769): Launched 07:29:01.032700 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:29:01.264136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:01.608146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22770): Launched 07:29:01.916261 run iperf3-srv_10.42.42.10(pid=22771): Launched 07:29:02.057393 tst iperf3m4.py:8: start network... 07:29:02.283472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:02.794979 run create_hlr_db(pid=22772): Launched 07:29:02.921159 bus /gobi_6: Setting Powered False 07:29:03.986018 run create_hlr_db(pid=22772): Terminated: ok {rc=0} 07:29:04.443439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22774): Launched 07:29:04.773978 run osmo-hlr_10.42.42.2(pid=22775): Launched 07:29:04.899628 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:05.470753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22777): Launched 07:29:05.802098 run osmo-stp_10.42.42.5(pid=22778): Launched 07:29:05.927399 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:06.495149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22780): Launched 07:29:06.621982 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:06.899855 run patchelf(pid=22781): Launched 07:29:07.083454 run osmo-stp_10.42.42.5(pid=22778): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22778)] 07:29:07.222175 run osmo-stp_10.42.42.5(pid=22778): stdout: | (launched: 2022-12-14_07:29:05.741881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:07.363657 run osmo-stp_10.42.42.5(pid=22778): stderr: | 20221214072905931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072905931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072905931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072905932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072905932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072905932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072905932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:07.504611 run osmo-stp_10.42.42.5(pid=22778): stdout: | (launched: 2022-12-14_07:29:05.741881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:07.639285 run osmo-stp_10.42.42.5(pid=22778): stderr: | 20221214072905931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072905931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072905931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072905932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072905932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072905932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072905932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:07.798391 run patchelf(pid=22781): Terminating (SIGINT) 07:29:07.983497 run patchelf(pid=22781): Terminated: ok {rc=0} 07:29:08.117363 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22778): Process ended prematurely: osmo-stp_10.42.42.5(pid=22778) [trial-2401↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22778)] [trial-2401↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 07:29:08.127627 tst iperf3m4.py:8: Test FAILED (11.0 sec) 07:29:08.156342 run osmo-hlr_10.42.42.2(pid=22775): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22775)] 07:29:08.206803 run osmo-hlr_10.42.42.2(pid=22775): stdout: | (launched: 2022-12-14_07:29:04.713743) 07:29:08.258841 run osmo-hlr_10.42.42.2(pid=22775): stderr: | 20221214072904907 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072904908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072904908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072904908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072904908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072904908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072904923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072904932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072904932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072904932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:08.311118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22764): Terminating (SIGTERM) 07:29:08.353526 run iperf3-srv_10.42.42.10(pid=22765): Terminating (SIGTERM) 07:29:08.395475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22766): Terminating (SIGTERM) 07:29:08.437544 run iperf3-srv_10.42.42.10(pid=22767): Terminating (SIGTERM) 07:29:08.479507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22768): Terminating (SIGTERM) 07:29:08.521731 run iperf3-srv_10.42.42.10(pid=22769): Terminating (SIGTERM) 07:29:08.563591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22770): Terminating (SIGTERM) 07:29:08.605640 run iperf3-srv_10.42.42.10(pid=22771): Terminating (SIGTERM) 07:29:08.648804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22774): Terminating (SIGTERM) 07:29:08.690965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22777): Terminating (SIGTERM) 07:29:08.733117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22780): Terminating (SIGTERM) 07:29:08.775147 --- ParallelTerminationStrategy: PID 22764 died... 07:29:08.795393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22764): Terminated: ok {rc=0} 07:29:08.841719 --- ParallelTerminationStrategy: PID 22765 died... 07:29:08.861265 run iperf3-srv_10.42.42.10(pid=22765): Terminated {rc=256} 07:29:08.907432 --- ParallelTerminationStrategy: PID 22766 died... 07:29:08.927173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22766): Terminated: ok {rc=0} 07:29:08.973372 --- ParallelTerminationStrategy: PID 22767 died... 07:29:08.993090 run iperf3-srv_10.42.42.10(pid=22767): Terminated {rc=256} 07:29:09.039021 --- ParallelTerminationStrategy: PID 22768 died... 07:29:09.058712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22768): Terminated: ok {rc=0} 07:29:09.104788 --- ParallelTerminationStrategy: PID 22769 died... 07:29:09.124875 run iperf3-srv_10.42.42.10(pid=22769): Terminated {rc=256} 07:29:09.170887 --- ParallelTerminationStrategy: PID 22770 died... 07:29:09.190745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22770): Terminated: ok {rc=0} 07:29:09.237028 --- ParallelTerminationStrategy: PID 22771 died... 07:29:09.256739 run iperf3-srv_10.42.42.10(pid=22771): Terminated {rc=256} 07:29:09.302660 --- ParallelTerminationStrategy: PID 22774 died... 07:29:09.322472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22774): Terminated: ok {rc=0} 07:29:09.368912 --- ParallelTerminationStrategy: PID 22777 died... 07:29:09.388680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22777): Terminated: ok {rc=0} 07:29:09.434756 --- ParallelTerminationStrategy: PID 22780 died... 07:29:09.454544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22780): Terminated: ok {rc=0} 07:29:09.541957 bus /gobi_4: Setting Powered False 07:29:10.641953 bus /gobi_4: Setting Powered False 07:29:11.757903 bus /gobi_1: Setting Powered False 07:29:12.853098 bus /gobi_1: Setting Powered False 07:29:13.967008 bus /gobi_0: Setting Powered False 07:29:15.064541 bus /gobi_0: Setting Powered False 07:29:16.182762 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 07:29:17.288267 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:17.299762 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:29:17.349223 tst ping.py: using LAC 39354 07:29:17.467397 tst ping.py: using RAC 84 07:29:17.587250 tst ping.py: using CellId 39354 07:29:17.706677 tst ping.py: using BVCI 39355 07:29:17.817594 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:17.828346 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:17.839072 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:17.849730 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:17.860268 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:17.870760 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:17.881454 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:17.892057 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:29:18.007747 tst ping.py:19: start network... 07:29:18.209955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:18.672491 run create_hlr_db(pid=22782): Launched 07:29:18.795191 bus /gobi_6: Setting Powered False 07:29:19.854820 run create_hlr_db(pid=22782): Terminated: ok {rc=0} 07:29:20.273538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22784): Launched 07:29:20.575604 run osmo-hlr_10.42.42.2(pid=22785): Launched 07:29:20.691211 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:21.222991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22787): Launched 07:29:21.524082 run osmo-stp_10.42.42.5(pid=22788): Launched 07:29:21.638318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:22.158417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22790): Launched 07:29:22.276069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:22.530153 run patchelf(pid=22791): Launched 07:29:22.699894 run osmo-stp_10.42.42.5(pid=22788): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22788)] 07:29:22.827538 run osmo-stp_10.42.42.5(pid=22788): stdout: | (launched: 2022-12-14_07:29:21.468838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:22.956655 run osmo-stp_10.42.42.5(pid=22788): stderr: | 20221214072921634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072921634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072921634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072921635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072921635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072921635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072921635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:23.085896 run osmo-stp_10.42.42.5(pid=22788): stdout: | (launched: 2022-12-14_07:29:21.468838) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:23.208843 run osmo-stp_10.42.42.5(pid=22788): stderr: | 20221214072921634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072921634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072921634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072921635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072921635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072921635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072921635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:23.354470 run patchelf(pid=22791): Terminating (SIGINT) 07:29:23.524749 run patchelf(pid=22791): Terminated: ok {rc=0} 07:29:23.647523 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22788): Process ended prematurely: osmo-stp_10.42.42.5(pid=22788) [trial-2401↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22788)] [trial-2401↪gprs:trx-sysmocell5000↪ping.py:22] 07:29:23.656399 tst ping.py:22: Test FAILED (6.4 sec) 07:29:23.684290 run osmo-hlr_10.42.42.2(pid=22785): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22785)] 07:29:23.732295 run osmo-hlr_10.42.42.2(pid=22785): stdout: | (launched: 2022-12-14_07:29:20.520185) 07:29:23.782005 run osmo-hlr_10.42.42.2(pid=22785): stderr: | 20221214072920693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072920693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072920693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072920693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072920693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072920693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072920705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072920714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072920715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072920715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:23.832171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22784): Terminating (SIGTERM) 07:29:23.872261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22787): Terminating (SIGTERM) 07:29:23.912303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22790): Terminating (SIGTERM) 07:29:23.952583 --- ParallelTerminationStrategy: PID 22784 died... 07:29:23.971523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22784): Terminated: ok {rc=0} 07:29:24.015780 --- ParallelTerminationStrategy: PID 22787 died... 07:29:24.034741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22787): Terminated: ok {rc=0} 07:29:24.078811 --- ParallelTerminationStrategy: PID 22790 died... 07:29:24.097519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22790): Terminated: ok {rc=0} 07:29:24.183799 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 07:29:25.273132 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:25.284576 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:29:25.335825 tst ping_idle_ping.py: using LAC 39355 07:29:25.456165 tst ping_idle_ping.py: using RAC 85 07:29:25.576548 tst ping_idle_ping.py: using CellId 39355 07:29:25.694248 tst ping_idle_ping.py: using BVCI 39356 07:29:25.803879 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:25.815134 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:25.825950 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:25.836578 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:25.847166 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:25.858808 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:25.870246 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:29:25.881524 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:29:26.001587 tst ping_idle_ping.py:24: start network... 07:29:26.220364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:26.724493 run create_hlr_db(pid=22792): Launched 07:29:26.849200 bus /gobi_6: Setting Powered False 07:29:27.912908 run create_hlr_db(pid=22792): Terminated: ok {rc=0} 07:29:28.347205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22794): Launched 07:29:28.650610 run osmo-hlr_10.42.42.2(pid=22795): Launched 07:29:28.766344 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:29.287227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22797): Launched 07:29:29.589797 run osmo-stp_10.42.42.5(pid=22798): Launched 07:29:29.704918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:30.226300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22800): Launched 07:29:30.341943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:30.596401 run patchelf(pid=22801): Launched 07:29:30.764798 run osmo-stp_10.42.42.5(pid=22798): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22798)] 07:29:30.902456 run osmo-stp_10.42.42.5(pid=22798): stdout: | (launched: 2022-12-14_07:29:29.534323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:31.034547 run osmo-stp_10.42.42.5(pid=22798): stderr: | 20221214072929702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072929702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072929702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072929703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072929703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072929703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072929703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:31.166664 run osmo-stp_10.42.42.5(pid=22798): stdout: | (launched: 2022-12-14_07:29:29.534323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:31.292647 run osmo-stp_10.42.42.5(pid=22798): stderr: | 20221214072929702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072929702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072929702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072929703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072929703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072929703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072929703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:31.441409 run patchelf(pid=22801): Terminating (SIGINT) 07:29:31.615912 run patchelf(pid=22801): Terminated: ok {rc=0} 07:29:31.742281 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22798): Process ended prematurely: osmo-stp_10.42.42.5(pid=22798) [trial-2401↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22798)] [trial-2401↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 07:29:31.751878 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 07:29:31.779587 run osmo-hlr_10.42.42.2(pid=22795): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22795)] 07:29:31.828373 run osmo-hlr_10.42.42.2(pid=22795): stdout: | (launched: 2022-12-14_07:29:28.595071) 07:29:31.878832 run osmo-hlr_10.42.42.2(pid=22795): stderr: | 20221214072928767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072928767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072928767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072928767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072928767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072928767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072928783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072928793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072928794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072928794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:31.929691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22794): Terminating (SIGTERM) 07:29:31.971225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22797): Terminating (SIGTERM) 07:29:32.014323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22800): Terminating (SIGTERM) 07:29:32.057241 --- ParallelTerminationStrategy: PID 22794 died... 07:29:32.076495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22794): Terminated: ok {rc=0} 07:29:32.121650 --- ParallelTerminationStrategy: PID 22797 died... 07:29:32.140912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22797): Terminated: ok {rc=0} 07:29:32.185401 --- ParallelTerminationStrategy: PID 22800 died... 07:29:32.204497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22800): Terminated: ok {rc=0} 07:29:32.289055 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 07:29:33.603628 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:29:33.609900 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:29:33.644778 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:29:33.685903 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:29:33.774869 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:29:33.808751 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:29:33.847852 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:29:34.445567 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:29:34.498515 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:34.510087 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:29:34.563385 tst cs_paging_gprs_active.py: using LAC 39356 07:29:34.693232 tst cs_paging_gprs_active.py: using RAC 86 07:29:34.822599 tst cs_paging_gprs_active.py: using CellId 39356 07:29:34.952682 tst cs_paging_gprs_active.py: using BVCI 39357 07:29:35.072496 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:35.083998 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:35.095284 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:35.106490 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:35.117674 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:35.129119 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:35.140599 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:35.152153 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:35.163763 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:29:35.288579 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:29:35.412350 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:29:35.635136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:35.966436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22805): Launched 07:29:36.253423 run iperf3-srv_10.42.42.10(pid=22806): Launched 07:29:36.378927 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:29:36.603295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:36.936420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22807): Launched 07:29:37.224098 run iperf3-srv_10.42.42.10(pid=22808): Launched 07:29:37.350212 tst cs_paging_gprs_active.py:38: start network... 07:29:37.573528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:38.083896 run create_hlr_db(pid=22809): Launched 07:29:38.210895 bus /gobi_6: Setting Powered False 07:29:39.276037 run create_hlr_db(pid=22809): Terminated: ok {rc=0} 07:29:39.735737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22811): Launched 07:29:40.061627 run osmo-hlr_10.42.42.2(pid=22812): Launched 07:29:40.180450 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:40.715360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22814): Launched 07:29:41.023566 run osmo-stp_10.42.42.5(pid=22815): Launched 07:29:41.140394 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:41.674411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22817): Launched 07:29:41.795144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:42.057803 run patchelf(pid=22818): Launched 07:29:42.231019 run osmo-stp_10.42.42.5(pid=22815): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22815)] 07:29:42.362006 run osmo-stp_10.42.42.5(pid=22815): stdout: | (launched: 2022-12-14_07:29:40.967158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:42.494367 run osmo-stp_10.42.42.5(pid=22815): stderr: | 20221214072941135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072941135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072941136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072941136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072941137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072941137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072941137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:42.626543 run osmo-stp_10.42.42.5(pid=22815): stdout: | (launched: 2022-12-14_07:29:40.967158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:42.753381 run osmo-stp_10.42.42.5(pid=22815): stderr: | 20221214072941135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072941135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072941136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072941136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072941137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072941137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072941137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:42.903627 run patchelf(pid=22818): Terminating (SIGINT) 07:29:43.079211 run patchelf(pid=22818): Terminated: ok {rc=0} 07:29:43.206067 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22815): Process ended prematurely: osmo-stp_10.42.42.5(pid=22815) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22815)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:29:43.215436 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:29:43.242306 run osmo-hlr_10.42.42.2(pid=22812): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22812)] 07:29:43.289545 run osmo-hlr_10.42.42.2(pid=22812): stdout: | (launched: 2022-12-14_07:29:40.005228) 07:29:43.338801 run osmo-hlr_10.42.42.2(pid=22812): stderr: | 20221214072940178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072940178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072940178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072940178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072940178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072940178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072940190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072940200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072940200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072940200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:43.388226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22805): Terminating (SIGTERM) 07:29:43.428013 run iperf3-srv_10.42.42.10(pid=22806): Terminating (SIGTERM) 07:29:43.467604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22807): Terminating (SIGTERM) 07:29:43.507425 run iperf3-srv_10.42.42.10(pid=22808): Terminating (SIGTERM) 07:29:43.546928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22811): Terminating (SIGTERM) 07:29:43.586572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22814): Terminating (SIGTERM) 07:29:43.626383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22817): Terminating (SIGTERM) 07:29:43.666383 --- ParallelTerminationStrategy: PID 22805 died... 07:29:43.685379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22805): Terminated: ok {rc=0} 07:29:43.729201 --- ParallelTerminationStrategy: PID 22806 died... 07:29:43.747511 run iperf3-srv_10.42.42.10(pid=22806): Terminated {rc=256} 07:29:43.791021 --- ParallelTerminationStrategy: PID 22807 died... 07:29:43.809505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22807): Terminated: ok {rc=0} 07:29:43.853649 --- ParallelTerminationStrategy: PID 22808 died... 07:29:43.872099 run iperf3-srv_10.42.42.10(pid=22808): Terminated {rc=256} 07:29:43.915622 --- ParallelTerminationStrategy: PID 22811 died... 07:29:43.934061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22811): Terminated: ok {rc=0} 07:29:43.977463 --- ParallelTerminationStrategy: PID 22814 died... 07:29:43.995942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22814): Terminated: ok {rc=0} 07:29:44.039177 --- ParallelTerminationStrategy: PID 22817 died... 07:29:44.057751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22817): Terminated: ok {rc=0} 07:29:44.140774 bus /gobi_0: Setting Powered False 07:29:45.237774 bus /gobi_0: Setting Powered False 07:29:46.358158 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:29:47.503953 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:47.515599 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:29:47.570353 tst iperf3.py: using LAC 39357 07:29:47.692024 tst iperf3.py: using RAC 87 07:29:47.813671 tst iperf3.py: using CellId 39357 07:29:47.933743 tst iperf3.py: using BVCI 39358 07:29:48.046310 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:48.057484 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:48.068229 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:48.079044 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:48.089823 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:48.100576 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:48.111528 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:48.122192 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:48.133363 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:29:48.253413 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:29:48.475946 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:48.805767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22819): Launched 07:29:49.093821 run iperf3-srv_10.42.42.10(pid=22820): Launched 07:29:49.219643 tst iperf3.py:8: start network... 07:29:49.443421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:49.955087 run create_hlr_db(pid=22821): Launched 07:29:50.083217 bus /gobi_6: Setting Powered False 07:29:51.146585 run create_hlr_db(pid=22821): Terminated: ok {rc=0} 07:29:51.603273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22823): Launched 07:29:51.934814 run osmo-hlr_10.42.42.2(pid=22824): Launched 07:29:52.060685 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:52.632860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22826): Launched 07:29:52.961797 run osmo-stp_10.42.42.5(pid=22827): Launched 07:29:53.088249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:53.655433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22829): Launched 07:29:53.782411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:54.061487 run patchelf(pid=22830): Launched 07:29:54.245638 run osmo-stp_10.42.42.5(pid=22827): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22827)] 07:29:54.385248 run osmo-stp_10.42.42.5(pid=22827): stdout: | (launched: 2022-12-14_07:29:52.902245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:54.526279 run osmo-stp_10.42.42.5(pid=22827): stderr: | 20221214072953090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072953091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072953091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072953091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072953092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072953092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072953092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:54.667789 run osmo-stp_10.42.42.5(pid=22827): stdout: | (launched: 2022-12-14_07:29:52.902245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:54.802535 run osmo-stp_10.42.42.5(pid=22827): stderr: | 20221214072953090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214072953091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214072953091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214072953091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214072953092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214072953092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214072953092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:54.962241 run patchelf(pid=22830): Terminating (SIGINT) 07:29:55.147746 run patchelf(pid=22830): Terminated: ok {rc=0} 07:29:55.281807 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22827): Process ended prematurely: osmo-stp_10.42.42.5(pid=22827) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22827)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 07:29:55.292201 tst iperf3.py:8: Test FAILED (7.8 sec) 07:29:55.321098 run osmo-hlr_10.42.42.2(pid=22824): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22824)] 07:29:55.372107 run osmo-hlr_10.42.42.2(pid=22824): stdout: | (launched: 2022-12-14_07:29:51.873918) 07:29:55.424534 run osmo-hlr_10.42.42.2(pid=22824): stderr: | 20221214072952069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214072952069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214072952069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214072952069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214072952069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214072952070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214072952082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214072952090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214072952090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214072952090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:55.477402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22819): Terminating (SIGTERM) 07:29:55.520105 run iperf3-srv_10.42.42.10(pid=22820): Terminating (SIGTERM) 07:29:55.562510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22823): Terminating (SIGTERM) 07:29:55.604873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22826): Terminating (SIGTERM) 07:29:55.647310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22829): Terminating (SIGTERM) 07:29:55.689685 --- ParallelTerminationStrategy: PID 22819 died... 07:29:55.709941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22819): Terminated: ok {rc=0} 07:29:55.756408 --- ParallelTerminationStrategy: PID 22820 died... 07:29:55.776323 run iperf3-srv_10.42.42.10(pid=22820): Terminated {rc=256} 07:29:55.822515 --- ParallelTerminationStrategy: PID 22823 died... 07:29:55.842462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22823): Terminated: ok {rc=0} 07:29:55.888776 --- ParallelTerminationStrategy: PID 22826 died... 07:29:55.909319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22826): Terminated: ok {rc=0} 07:29:55.955824 --- ParallelTerminationStrategy: PID 22829 died... 07:29:55.975725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22829): Terminated: ok {rc=0} 07:29:56.064092 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:29:57.213951 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:57.226190 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:29:57.279476 tst iperf3m4.py: using LAC 39358 07:29:57.403905 tst iperf3m4.py: using RAC 88 07:29:57.524375 tst iperf3m4.py: using CellId 39358 07:29:57.644291 tst iperf3m4.py: using BVCI 39359 07:29:57.756168 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:57.767254 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:57.778016 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:57.789078 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:57.799743 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:57.810608 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:57.821527 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:57.832221 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:29:57.843066 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:29:57.964707 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:29:58.084426 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:29:58.206086 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:29:58.329495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:29:58.553325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:58.884368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22831): Launched 07:29:59.171296 run iperf3-srv_10.42.42.10(pid=22832): Launched 07:29:59.295329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:29:59.518356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:29:59.849227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22833): Launched 07:30:00.136901 run iperf3-srv_10.42.42.10(pid=22834): Launched 07:30:00.260671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:30:00.483196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:00.814117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22835): Launched 07:30:01.143062 run iperf3-srv_10.42.42.10(pid=22836): Launched 07:30:01.270613 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:30:01.483121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:01.816816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22840): Launched 07:30:02.145139 run iperf3-srv_10.42.42.10(pid=22841): Launched 07:30:02.290071 tst iperf3m4.py:8: start network... 07:30:02.496729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:02.973710 run create_hlr_db(pid=22842): Launched 07:30:03.099871 bus /gobi_6: Setting Powered False 07:30:04.161611 run create_hlr_db(pid=22842): Terminated: ok {rc=0} 07:30:04.589544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22844): Launched 07:30:04.900029 run osmo-hlr_10.42.42.2(pid=22845): Launched 07:30:05.015858 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:05.546676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22847): Launched 07:30:05.855053 run osmo-stp_10.42.42.5(pid=22848): Launched 07:30:05.972763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:06.501749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22850): Launched 07:30:06.620519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:06.882076 run patchelf(pid=22851): Launched 07:30:07.053563 run osmo-stp_10.42.42.5(pid=22848): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22848)] 07:30:07.182799 run osmo-stp_10.42.42.5(pid=22848): stdout: | (launched: 2022-12-14_07:30:05.798242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:07.314125 run osmo-stp_10.42.42.5(pid=22848): stderr: | 20221214073005964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073005964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073005965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073005965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073005965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073005966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073005966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:07.444778 run osmo-stp_10.42.42.5(pid=22848): stdout: | (launched: 2022-12-14_07:30:05.798242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:07.569674 run osmo-stp_10.42.42.5(pid=22848): stderr: | 20221214073005964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073005964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073005965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073005965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073005965 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073005966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073005966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:07.717426 run patchelf(pid=22851): Terminating (SIGINT) 07:30:07.890191 run patchelf(pid=22851): Terminated: ok {rc=0} 07:30:08.015112 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22848): Process ended prematurely: osmo-stp_10.42.42.5(pid=22848) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22848)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 07:30:08.024704 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:30:08.052110 run osmo-hlr_10.42.42.2(pid=22845): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22845)] 07:30:08.099436 run osmo-hlr_10.42.42.2(pid=22845): stdout: | (launched: 2022-12-14_07:30:04.842564) 07:30:08.148583 run osmo-hlr_10.42.42.2(pid=22845): stderr: | 20221214073005015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073005015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073005015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073005015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073005016 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073005016 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073005027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073005035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073005036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073005036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:08.198145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22831): Terminating (SIGTERM) 07:30:08.237923 run iperf3-srv_10.42.42.10(pid=22832): Terminating (SIGTERM) 07:30:08.277577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22833): Terminating (SIGTERM) 07:30:08.317375 run iperf3-srv_10.42.42.10(pid=22834): Terminating (SIGTERM) 07:30:08.356834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22835): Terminating (SIGTERM) 07:30:08.396325 run iperf3-srv_10.42.42.10(pid=22836): Terminating (SIGTERM) 07:30:08.435753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22840): Terminating (SIGTERM) 07:30:08.475371 run iperf3-srv_10.42.42.10(pid=22841): Terminating (SIGTERM) 07:30:08.514676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22844): Terminating (SIGTERM) 07:30:08.554278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22847): Terminating (SIGTERM) 07:30:08.593682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22850): Terminating (SIGTERM) 07:30:08.633452 --- ParallelTerminationStrategy: PID 22831 died... 07:30:08.652382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22831): Terminated: ok {rc=0} 07:30:08.696095 --- ParallelTerminationStrategy: PID 22832 died... 07:30:08.714541 run iperf3-srv_10.42.42.10(pid=22832): Terminated {rc=256} 07:30:08.758050 --- ParallelTerminationStrategy: PID 22833 died... 07:30:08.776427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22833): Terminated: ok {rc=0} 07:30:08.819738 --- ParallelTerminationStrategy: PID 22834 died... 07:30:08.838136 run iperf3-srv_10.42.42.10(pid=22834): Terminated {rc=256} 07:30:08.881339 --- ParallelTerminationStrategy: PID 22835 died... 07:30:08.899748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22835): Terminated: ok {rc=0} 07:30:08.943113 --- ParallelTerminationStrategy: PID 22836 died... 07:30:08.961525 run iperf3-srv_10.42.42.10(pid=22836): Terminated {rc=256} 07:30:09.004934 --- ParallelTerminationStrategy: PID 22840 died... 07:30:09.023439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22840): Terminated: ok {rc=0} 07:30:09.067007 --- ParallelTerminationStrategy: PID 22841 died... 07:30:09.085480 run iperf3-srv_10.42.42.10(pid=22841): Terminated {rc=256} 07:30:09.128843 --- ParallelTerminationStrategy: PID 22844 died... 07:30:09.147713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22844): Terminated: ok {rc=0} 07:30:09.191287 --- ParallelTerminationStrategy: PID 22847 died... 07:30:09.209723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22847): Terminated: ok {rc=0} 07:30:09.253185 --- ParallelTerminationStrategy: PID 22850 died... 07:30:09.271628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22850): Terminated: ok {rc=0} 07:30:09.357068 bus /gobi_4: Setting Powered False 07:30:10.456875 bus /gobi_4: Setting Powered False 07:30:11.572575 bus /gobi_1: Setting Powered False 07:30:12.671213 bus /gobi_1: Setting Powered False 07:30:13.786471 bus /gobi_0: Setting Powered False 07:30:14.884731 bus /gobi_0: Setting Powered False 07:30:16.022340 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 07:30:17.138685 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:17.150901 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:30:17.204244 tst ping.py: using LAC 39359 07:30:17.329059 tst ping.py: using RAC 89 07:30:17.446232 tst ping.py: using CellId 39359 07:30:17.566850 tst ping.py: using BVCI 39360 07:30:17.677206 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:17.688223 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:17.699098 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:17.709920 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:17.720549 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:17.731348 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:17.742324 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:17.753172 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:30:17.873745 tst ping.py:19: start network... 07:30:18.091217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:18.590598 run create_hlr_db(pid=22852): Launched 07:30:18.715269 bus /gobi_6: Setting Powered False 07:30:19.779216 run create_hlr_db(pid=22852): Terminated: ok {rc=0} 07:30:20.230658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22854): Launched 07:30:20.555922 run osmo-hlr_10.42.42.2(pid=22855): Launched 07:30:20.680294 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:21.241306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22857): Launched 07:30:21.564250 run osmo-stp_10.42.42.5(pid=22858): Launched 07:30:21.686902 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:22.242609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22860): Launched 07:30:22.368167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:22.641218 run patchelf(pid=22861): Launched 07:30:22.821401 run osmo-stp_10.42.42.5(pid=22858): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22858)] 07:30:22.958177 run osmo-stp_10.42.42.5(pid=22858): stdout: | (launched: 2022-12-14_07:30:21.505494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:23.096828 run osmo-stp_10.42.42.5(pid=22858): stderr: | 20221214073021694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073021694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073021694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073021695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073021695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073021695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073021695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:23.235680 run osmo-stp_10.42.42.5(pid=22858): stdout: | (launched: 2022-12-14_07:30:21.505494) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:23.367460 run osmo-stp_10.42.42.5(pid=22858): stderr: | 20221214073021694 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073021694 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073021694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073021695 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073021695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073021695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073021695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:23.524209 run patchelf(pid=22861): Terminating (SIGINT) 07:30:23.706697 run patchelf(pid=22861): Terminated: ok {rc=0} 07:30:23.837983 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22858): Process ended prematurely: osmo-stp_10.42.42.5(pid=22858) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22858)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 07:30:23.847488 tst ping.py:22: Test FAILED (6.7 sec) 07:30:23.875450 run osmo-hlr_10.42.42.2(pid=22855): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22855)] 07:30:23.925754 run osmo-hlr_10.42.42.2(pid=22855): stdout: | (launched: 2022-12-14_07:30:20.496844) 07:30:23.977928 run osmo-hlr_10.42.42.2(pid=22855): stderr: | 20221214073020691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073020691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073020691 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073020691 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073020691 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073020691 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073020703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073020711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073020711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073020711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:24.029765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22854): Terminating (SIGTERM) 07:30:24.071661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22857): Terminating (SIGTERM) 07:30:24.114006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22860): Terminating (SIGTERM) 07:30:24.156120 --- ParallelTerminationStrategy: PID 22854 died... 07:30:24.176401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22854): Terminated: ok {rc=0} 07:30:24.222937 --- ParallelTerminationStrategy: PID 22857 died... 07:30:24.242777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22857): Terminated: ok {rc=0} 07:30:24.288845 --- ParallelTerminationStrategy: PID 22860 died... 07:30:24.309246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22860): Terminated: ok {rc=0} 07:30:24.397007 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:30:25.483962 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:25.496379 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:30:25.549465 tst ping_idle_ping.py: using LAC 39360 07:30:25.677397 tst ping_idle_ping.py: using RAC 90 07:30:25.805302 tst ping_idle_ping.py: using CellId 39360 07:30:25.924733 tst ping_idle_ping.py: using BVCI 39361 07:30:26.044020 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:26.055754 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:26.067172 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:26.078620 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:26.090275 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:26.101542 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:26.113457 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:30:26.125144 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:30:26.246419 tst ping_idle_ping.py:24: start network... 07:30:26.466213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:26.970419 run create_hlr_db(pid=22863): Launched 07:30:27.094872 bus /gobi_6: Setting Powered False 07:30:28.159291 run create_hlr_db(pid=22863): Terminated: ok {rc=0} 07:30:28.594208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22865): Launched 07:30:28.897686 run osmo-hlr_10.42.42.2(pid=22866): Launched 07:30:29.013741 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:29.544190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22868): Launched 07:30:29.846864 run osmo-stp_10.42.42.5(pid=22869): Launched 07:30:29.961553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:30.483397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22871): Launched 07:30:30.601472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:30.856684 run patchelf(pid=22872): Launched 07:30:31.043114 run osmo-stp_10.42.42.5(pid=22869): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22869)] 07:30:31.173815 run osmo-stp_10.42.42.5(pid=22869): stdout: | (launched: 2022-12-14_07:30:29.790792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:31.305406 run osmo-stp_10.42.42.5(pid=22869): stderr: | 20221214073029959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073029959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073029960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073029960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073029961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073029961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073029961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:31.438193 run osmo-stp_10.42.42.5(pid=22869): stdout: | (launched: 2022-12-14_07:30:29.790792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:31.564834 run osmo-stp_10.42.42.5(pid=22869): stderr: | 20221214073029959 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073029959 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073029960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073029960 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073029961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073029961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073029961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:31.733630 run patchelf(pid=22872): Terminating (SIGINT) 07:30:31.908020 run patchelf(pid=22872): Terminated: ok {rc=0} 07:30:32.033799 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22869): Process ended prematurely: osmo-stp_10.42.42.5(pid=22869) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22869)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 07:30:32.043319 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:30:32.071427 run osmo-hlr_10.42.42.2(pid=22866): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22866)] 07:30:32.120790 run osmo-hlr_10.42.42.2(pid=22866): stdout: | (launched: 2022-12-14_07:30:28.842089) 07:30:32.171593 run osmo-hlr_10.42.42.2(pid=22866): stderr: | 20221214073029014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073029014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073029015 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073029015 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073029015 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073029015 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073029027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073029035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073029035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073029035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:32.222653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22865): Terminating (SIGTERM) 07:30:32.263821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22868): Terminating (SIGTERM) 07:30:32.303569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22871): Terminating (SIGTERM) 07:30:32.343635 --- ParallelTerminationStrategy: PID 22865 died... 07:30:32.362846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22865): Terminated: ok {rc=0} 07:30:32.407082 --- ParallelTerminationStrategy: PID 22868 died... 07:30:32.425744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22868): Terminated: ok {rc=0} 07:30:32.469457 --- ParallelTerminationStrategy: PID 22871 died... 07:30:32.488029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22871): Terminated: ok {rc=0} 07:30:32.573192 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:30:33.882250 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:30:33.889368 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:30:33.924704 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:30:33.964513 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:30:34.055254 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:30:34.088524 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:30:34.126247 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:30:34.724795 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:30:34.778011 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:34.789564 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:30:34.861371 tst cs_paging_gprs_active.py: using LAC 39361 07:30:34.982416 tst cs_paging_gprs_active.py: using RAC 91 07:30:35.104314 tst cs_paging_gprs_active.py: using CellId 39361 07:30:35.227501 tst cs_paging_gprs_active.py: using BVCI 39362 07:30:35.339992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:35.351159 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:35.362166 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:35.373036 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:35.383853 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:35.394702 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:35.405678 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:35.416374 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:35.427393 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:30:35.548497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:30:35.667204 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:30:35.873023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:36.181512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22877): Launched 07:30:36.452049 run iperf3-srv_10.42.42.10(pid=22878): Launched 07:30:36.567460 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:30:36.773540 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:37.082563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22879): Launched 07:30:37.350705 run iperf3-srv_10.42.42.10(pid=22880): Launched 07:30:37.467458 tst cs_paging_gprs_active.py:38: start network... 07:30:37.672790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:38.147264 run create_hlr_db(pid=22881): Launched 07:30:38.274258 bus /gobi_6: Setting Powered False 07:30:39.334809 run create_hlr_db(pid=22881): Terminated: ok {rc=0} 07:30:39.783417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22883): Launched 07:30:40.113894 run osmo-hlr_10.42.42.2(pid=22884): Launched 07:30:40.240934 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:40.811529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22886): Launched 07:30:41.140544 run osmo-stp_10.42.42.5(pid=22887): Launched 07:30:41.266219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:41.834617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22889): Launched 07:30:41.961121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:42.240400 run patchelf(pid=22890): Launched 07:30:42.424444 run osmo-stp_10.42.42.5(pid=22887): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22887)] 07:30:42.563918 run osmo-stp_10.42.42.5(pid=22887): stdout: | (launched: 2022-12-14_07:30:41.080654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:42.704257 run osmo-stp_10.42.42.5(pid=22887): stderr: | 20221214073041271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073041271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073041271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073041271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073041272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073041272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073041272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:42.844509 run osmo-stp_10.42.42.5(pid=22887): stdout: | (launched: 2022-12-14_07:30:41.080654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:42.978895 run osmo-stp_10.42.42.5(pid=22887): stderr: | 20221214073041271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073041271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073041271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073041271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073041272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073041272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073041272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:43.138471 run patchelf(pid=22890): Terminating (SIGINT) 07:30:43.324044 run patchelf(pid=22890): Terminated: ok {rc=0} 07:30:43.458434 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22887): Process ended prematurely: osmo-stp_10.42.42.5(pid=22887) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22887)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:30:43.468656 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:30:43.497345 run osmo-hlr_10.42.42.2(pid=22884): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22884)] 07:30:43.548493 run osmo-hlr_10.42.42.2(pid=22884): stdout: | (launched: 2022-12-14_07:30:40.054006) 07:30:43.600942 run osmo-hlr_10.42.42.2(pid=22884): stderr: | 20221214073040250 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073040250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073040250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073040250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073040250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073040250 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073040262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073040271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073040271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073040271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:43.653286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22877): Terminating (SIGTERM) 07:30:43.694880 run iperf3-srv_10.42.42.10(pid=22878): Terminating (SIGTERM) 07:30:43.737396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22879): Terminating (SIGTERM) 07:30:43.779546 run iperf3-srv_10.42.42.10(pid=22880): Terminating (SIGTERM) 07:30:43.821512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22883): Terminating (SIGTERM) 07:30:43.863862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22886): Terminating (SIGTERM) 07:30:43.906126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22889): Terminating (SIGTERM) 07:30:43.948117 --- ParallelTerminationStrategy: PID 22877 died... 07:30:43.968238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22877): Terminated: ok {rc=0} 07:30:44.014514 --- ParallelTerminationStrategy: PID 22878 died... 07:30:44.034168 run iperf3-srv_10.42.42.10(pid=22878): Terminated {rc=256} 07:30:44.080159 --- ParallelTerminationStrategy: PID 22879 died... 07:30:44.099899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22879): Terminated: ok {rc=0} 07:30:44.146442 --- ParallelTerminationStrategy: PID 22880 died... 07:30:44.166134 run iperf3-srv_10.42.42.10(pid=22880): Terminated {rc=256} 07:30:44.212154 --- ParallelTerminationStrategy: PID 22883 died... 07:30:44.231979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22883): Terminated: ok {rc=0} 07:30:44.278284 --- ParallelTerminationStrategy: PID 22886 died... 07:30:44.298150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22886): Terminated: ok {rc=0} 07:30:44.344571 --- ParallelTerminationStrategy: PID 22889 died... 07:30:44.364440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22889): Terminated: ok {rc=0} 07:30:44.452894 bus /gobi_0: Setting Powered False 07:30:45.551437 bus /gobi_0: Setting Powered False 07:30:46.670712 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:30:47.823828 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:47.836053 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:30:47.910832 tst iperf3.py: using LAC 39362 07:30:48.040273 tst iperf3.py: using RAC 92 07:30:48.168590 tst iperf3.py: using CellId 39362 07:30:48.298429 tst iperf3.py: using BVCI 39363 07:30:48.420616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:48.432223 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:48.443604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:48.455128 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:48.466863 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:48.478610 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:48.490333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:48.501834 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:48.513639 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:30:48.635133 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:30:48.857401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:49.186824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22892): Launched 07:30:49.475450 run iperf3-srv_10.42.42.10(pid=22893): Launched 07:30:49.600654 tst iperf3.py:8: start network... 07:30:49.822210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:50.330855 run create_hlr_db(pid=22894): Launched 07:30:50.456725 bus /gobi_6: Setting Powered False 07:30:51.521170 run create_hlr_db(pid=22894): Terminated: ok {rc=0} 07:30:51.965249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22896): Launched 07:30:52.274696 run osmo-hlr_10.42.42.2(pid=22900): Launched 07:30:52.394454 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:52.923097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22902): Launched 07:30:53.230998 run osmo-stp_10.42.42.5(pid=22903): Launched 07:30:53.347873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:30:53.876289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22905): Launched 07:30:53.994657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:30:54.254893 run patchelf(pid=22906): Launched 07:30:54.427688 run osmo-stp_10.42.42.5(pid=22903): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22903)] 07:30:54.557676 run osmo-stp_10.42.42.5(pid=22903): stdout: | (launched: 2022-12-14_07:30:53.174625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:54.689314 run osmo-stp_10.42.42.5(pid=22903): stderr: | 20221214073053343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073053343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073053343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073053344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073053344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073053344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073053344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:54.820829 run osmo-stp_10.42.42.5(pid=22903): stdout: | (launched: 2022-12-14_07:30:53.174625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:54.946261 run osmo-stp_10.42.42.5(pid=22903): stderr: | 20221214073053343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073053343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073053343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073053344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073053344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073053344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073053344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:55.095179 run patchelf(pid=22906): Terminating (SIGINT) 07:30:55.269238 run patchelf(pid=22906): Terminated: ok {rc=0} 07:30:55.394762 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22903): Process ended prematurely: osmo-stp_10.42.42.5(pid=22903) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22903)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 07:30:55.404859 tst iperf3.py:8: Test FAILED (7.6 sec) 07:30:55.431927 run osmo-hlr_10.42.42.2(pid=22900): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22900)] 07:30:55.479630 run osmo-hlr_10.42.42.2(pid=22900): stdout: | (launched: 2022-12-14_07:30:52.218614) 07:30:55.529066 run osmo-hlr_10.42.42.2(pid=22900): stderr: | 20221214073052391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073052391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073052391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073052391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073052392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073052392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073052403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073052412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073052412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073052412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:55.578716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22892): Terminating (SIGTERM) 07:30:55.618543 run iperf3-srv_10.42.42.10(pid=22893): Terminating (SIGTERM) 07:30:55.658099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22896): Terminating (SIGTERM) 07:30:55.697922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22902): Terminating (SIGTERM) 07:30:55.737572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22905): Terminating (SIGTERM) 07:30:55.777545 --- ParallelTerminationStrategy: PID 22892 died... 07:30:55.796680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22892): Terminated: ok {rc=0} 07:30:55.840573 --- ParallelTerminationStrategy: PID 22893 died... 07:30:55.859076 run iperf3-srv_10.42.42.10(pid=22893): Terminated {rc=256} 07:30:55.902443 --- ParallelTerminationStrategy: PID 22896 died... 07:30:55.920853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22896): Terminated: ok {rc=0} 07:30:55.964063 --- ParallelTerminationStrategy: PID 22902 died... 07:30:55.982442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22902): Terminated: ok {rc=0} 07:30:56.025744 --- ParallelTerminationStrategy: PID 22905 died... 07:30:56.044090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22905): Terminated: ok {rc=0} 07:30:56.127326 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:30:57.278724 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:57.291179 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:30:57.366149 tst iperf3m4.py: using LAC 39363 07:30:57.497119 tst iperf3m4.py: using RAC 93 07:30:57.625582 tst iperf3m4.py: using CellId 39363 07:30:57.747025 tst iperf3m4.py: using BVCI 39364 07:30:57.860911 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:57.872275 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:57.883398 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:57.894294 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:57.905212 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:57.916160 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:57.927231 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:57.938031 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:30:57.949034 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:30:58.067595 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:30:58.193139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:30:58.315606 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:30:58.438062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:30:58.661687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:58.993323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22907): Launched 07:30:59.281430 run iperf3-srv_10.42.42.10(pid=22908): Launched 07:30:59.406461 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:30:59.629945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:30:59.961192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22909): Launched 07:31:00.249250 run iperf3-srv_10.42.42.10(pid=22910): Launched 07:31:00.365581 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:31:00.573117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:31:00.893679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22911): Launched 07:31:01.213562 run iperf3-srv_10.42.42.10(pid=22912): Launched 07:31:01.335097 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:31:01.545334 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:31:01.862254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22913): Launched 07:31:02.186586 run iperf3-srv_10.42.42.10(pid=22914): Launched 07:31:02.316757 tst iperf3m4.py:8: start network... 07:31:02.523354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:02.999969 run create_hlr_db(pid=22915): Launched 07:31:03.126431 bus /gobi_6: Setting Powered False 07:31:04.187609 run create_hlr_db(pid=22915): Terminated: ok {rc=0} 07:31:04.616693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22917): Launched 07:31:04.925601 run osmo-hlr_10.42.42.2(pid=22918): Launched 07:31:05.042896 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:05.579735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22920): Launched 07:31:05.888175 run osmo-stp_10.42.42.5(pid=22921): Launched 07:31:06.005443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:31:06.537397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22923): Launched 07:31:06.656746 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:31:06.917765 run patchelf(pid=22924): Launched 07:31:07.088828 run osmo-stp_10.42.42.5(pid=22921): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22921)] 07:31:07.218475 run osmo-stp_10.42.42.5(pid=22921): stdout: | (launched: 2022-12-14_07:31:05.831877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:07.350189 run osmo-stp_10.42.42.5(pid=22921): stderr: | 20221214073106000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073106000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073106000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073106001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073106001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073106001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073106001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:07.481860 run osmo-stp_10.42.42.5(pid=22921): stdout: | (launched: 2022-12-14_07:31:05.831877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:07.607278 run osmo-stp_10.42.42.5(pid=22921): stderr: | 20221214073106000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073106000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073106000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073106001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073106001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073106001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073106001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:07.755307 run patchelf(pid=22924): Terminating (SIGINT) 07:31:07.929589 run patchelf(pid=22924): Terminated: ok {rc=0} 07:31:08.054903 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22921): Process ended prematurely: osmo-stp_10.42.42.5(pid=22921) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22921)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:31:08.064412 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:31:08.091877 run osmo-hlr_10.42.42.2(pid=22918): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22918)] 07:31:08.139008 run osmo-hlr_10.42.42.2(pid=22918): stdout: | (launched: 2022-12-14_07:31:04.869179) 07:31:08.188027 run osmo-hlr_10.42.42.2(pid=22918): stderr: | 20221214073105041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073105041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073105041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073105041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073105041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073105041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073105054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073105062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073105062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073105062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:08.238091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22907): Terminating (SIGTERM) 07:31:08.277851 run iperf3-srv_10.42.42.10(pid=22908): Terminating (SIGTERM) 07:31:08.317617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22909): Terminating (SIGTERM) 07:31:08.357495 run iperf3-srv_10.42.42.10(pid=22910): Terminating (SIGTERM) 07:31:08.397186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22911): Terminating (SIGTERM) 07:31:08.436935 run iperf3-srv_10.42.42.10(pid=22912): Terminating (SIGTERM) 07:31:08.476598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22913): Terminating (SIGTERM) 07:31:08.516991 run iperf3-srv_10.42.42.10(pid=22914): Terminating (SIGTERM) 07:31:08.556637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22917): Terminating (SIGTERM) 07:31:08.596316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22920): Terminating (SIGTERM) 07:31:08.635867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22923): Terminating (SIGTERM) 07:31:08.675662 --- ParallelTerminationStrategy: PID 22907 died... 07:31:08.694629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22907): Terminated: ok {rc=0} 07:31:08.738444 --- ParallelTerminationStrategy: PID 22908 died... 07:31:08.756765 run iperf3-srv_10.42.42.10(pid=22908): Terminated {rc=256} 07:31:08.799888 --- ParallelTerminationStrategy: PID 22909 died... 07:31:08.818431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22909): Terminated: ok {rc=0} 07:31:08.861890 --- ParallelTerminationStrategy: PID 22910 died... 07:31:08.880229 run iperf3-srv_10.42.42.10(pid=22910): Terminated {rc=256} 07:31:08.923205 --- ParallelTerminationStrategy: PID 22911 died... 07:31:08.941615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22911): Terminated: ok {rc=0} 07:31:08.985695 --- ParallelTerminationStrategy: PID 22912 died... 07:31:09.004016 run iperf3-srv_10.42.42.10(pid=22912): Terminated {rc=256} 07:31:09.047178 --- ParallelTerminationStrategy: PID 22913 died... 07:31:09.065610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22913): Terminated: ok {rc=0} 07:31:09.109214 --- ParallelTerminationStrategy: PID 22914 died... 07:31:09.127570 run iperf3-srv_10.42.42.10(pid=22914): Terminated {rc=256} 07:31:09.170873 --- ParallelTerminationStrategy: PID 22917 died... 07:31:09.189288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22917): Terminated: ok {rc=0} 07:31:09.232888 --- ParallelTerminationStrategy: PID 22920 died... 07:31:09.251807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22920): Terminated: ok {rc=0} 07:31:09.295255 --- ParallelTerminationStrategy: PID 22923 died... 07:31:09.313749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22923): Terminated: ok {rc=0} 07:31:09.397356 bus /gobi_4: Setting Powered False 07:31:10.495782 bus /gobi_4: Setting Powered False 07:31:11.613224 bus /gobi_1: Setting Powered False 07:31:12.709860 bus /gobi_1: Setting Powered False 07:31:13.824826 bus /gobi_0: Setting Powered False 07:31:14.923661 bus /gobi_0: Setting Powered False 07:31:16.050870 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:31:17.168512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:17.181503 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:31:17.252480 tst ping.py: using LAC 39364 07:31:17.371810 tst ping.py: using RAC 94 07:31:17.502434 tst ping.py: using CellId 39364 07:31:17.633209 tst ping.py: using BVCI 39365 07:31:17.751063 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:17.762831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:17.774649 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:17.786418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:17.798809 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:17.811259 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:17.823615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:17.835800 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:31:17.958405 tst ping.py:19: start network... 07:31:18.176885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:18.676902 run create_hlr_db(pid=22926): Launched 07:31:18.801871 bus /gobi_6: Setting Powered False 07:31:19.865453 run create_hlr_db(pid=22926): Terminated: ok {rc=0} 07:31:20.298405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22928): Launched 07:31:20.601037 run osmo-hlr_10.42.42.2(pid=22929): Launched 07:31:20.719038 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:21.255196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22931): Launched 07:31:21.556226 run osmo-stp_10.42.42.5(pid=22932): Launched 07:31:21.670837 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:31:22.188423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22934): Launched 07:31:22.303844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:31:22.557818 run patchelf(pid=22935): Launched 07:31:22.726293 run osmo-stp_10.42.42.5(pid=22932): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22932)] 07:31:22.853599 run osmo-stp_10.42.42.5(pid=22932): stdout: | (launched: 2022-12-14_07:31:21.500889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:22.982581 run osmo-stp_10.42.42.5(pid=22932): stderr: | 20221214073121669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073121669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073121669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073121670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073121670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073121670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073121670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:23.111838 run osmo-stp_10.42.42.5(pid=22932): stdout: | (launched: 2022-12-14_07:31:21.500889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:23.234486 run osmo-stp_10.42.42.5(pid=22932): stderr: | 20221214073121669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073121669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073121669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073121670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073121670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073121670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073121670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:23.379968 run patchelf(pid=22935): Terminating (SIGINT) 07:31:23.550457 run patchelf(pid=22935): Terminated: ok {rc=0} 07:31:23.673425 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22932): Process ended prematurely: osmo-stp_10.42.42.5(pid=22932) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22932)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 07:31:23.682228 tst ping.py:22: Test FAILED (6.5 sec) 07:31:23.708568 run osmo-hlr_10.42.42.2(pid=22929): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22929)] 07:31:23.755737 run osmo-hlr_10.42.42.2(pid=22929): stdout: | (launched: 2022-12-14_07:31:20.545057) 07:31:23.804641 run osmo-hlr_10.42.42.2(pid=22929): stderr: | 20221214073120717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073120717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073120717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073120717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073120717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073120717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073120730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073120738 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073120738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073120738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:23.853701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22928): Terminating (SIGTERM) 07:31:23.893009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22931): Terminating (SIGTERM) 07:31:23.932360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22934): Terminating (SIGTERM) 07:31:23.971815 --- ParallelTerminationStrategy: PID 22928 died... 07:31:23.990844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22928): Terminated: ok {rc=0} 07:31:24.034226 --- ParallelTerminationStrategy: PID 22931 died... 07:31:24.052525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22931): Terminated: ok {rc=0} 07:31:24.096356 --- ParallelTerminationStrategy: PID 22934 died... 07:31:24.115093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22934): Terminated: ok {rc=0} 07:31:24.200408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:31:25.288133 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:25.299999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:31:25.373201 tst ping_idle_ping.py: using LAC 39365 07:31:25.501107 tst ping_idle_ping.py: using RAC 95 07:31:25.622280 tst ping_idle_ping.py: using CellId 39365 07:31:25.743415 tst ping_idle_ping.py: using BVCI 39366 07:31:25.855192 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:25.866614 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:25.877734 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:25.888820 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:25.900180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:25.911557 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:25.923111 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:31:25.934477 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:31:26.053146 tst ping_idle_ping.py:24: start network... 07:31:26.256573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:26.731807 run create_hlr_db(pid=22936): Launched 07:31:26.855732 bus /gobi_6: Setting Powered False 07:31:27.915316 run create_hlr_db(pid=22936): Terminated: ok {rc=0} 07:31:28.358623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22938): Launched 07:31:28.685730 run osmo-hlr_10.42.42.2(pid=22939): Launched 07:31:28.809439 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:29.367638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22941): Launched 07:31:29.690099 run osmo-stp_10.42.42.5(pid=22942): Launched 07:31:29.814785 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:31:30.371455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22944): Launched 07:31:30.495822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:31:30.768748 run patchelf(pid=22945): Launched 07:31:30.969118 run osmo-stp_10.42.42.5(pid=22942): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22942)] 07:31:31.110002 run osmo-stp_10.42.42.5(pid=22942): stdout: | (launched: 2022-12-14_07:31:29.631386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:31.252193 run osmo-stp_10.42.42.5(pid=22942): stderr: | 20221214073129819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073129819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073129819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073129820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073129820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073129820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073129820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:31.394333 run osmo-stp_10.42.42.5(pid=22942): stdout: | (launched: 2022-12-14_07:31:29.631386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:31.529983 run osmo-stp_10.42.42.5(pid=22942): stderr: | 20221214073129819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073129819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073129819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073129820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073129820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073129820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073129820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:31.690869 run patchelf(pid=22945): Terminating (SIGINT) 07:31:31.877280 run patchelf(pid=22945): Terminated: ok {rc=0} 07:31:32.012425 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=22942): Process ended prematurely: osmo-stp_10.42.42.5(pid=22942) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22942)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:31:32.023266 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:31:32.052484 run osmo-hlr_10.42.42.2(pid=22939): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22939)] 07:31:32.107229 run osmo-hlr_10.42.42.2(pid=22939): stdout: | (launched: 2022-12-14_07:31:28.626126) 07:31:32.161401 run osmo-hlr_10.42.42.2(pid=22939): stderr: | 20221214073128820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073128820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073128820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073128821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073128821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073128821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073128833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073128841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073128841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073128842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:32.215810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22938): Terminating (SIGTERM) 07:31:32.257904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22941): Terminating (SIGTERM) 07:31:32.300753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22944): Terminating (SIGTERM) 07:31:32.343221 --- ParallelTerminationStrategy: PID 22938 died... 07:31:32.363612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22938): Terminated: ok {rc=0} 07:31:32.410258 --- ParallelTerminationStrategy: PID 22941 died... 07:31:32.430348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22941): Terminated: ok {rc=0} 07:31:32.476832 --- ParallelTerminationStrategy: PID 22944 died... 07:31:32.497230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22944): Terminated: ok {rc=0} 07:31:32.585367 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:31:33.896066 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:31:33.903154 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:31:33.936092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:31:33.974292 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:31:34.062785 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:31:34.098436 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:31:34.137879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:31:34.731134 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:31:34.784574 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:34.796301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:31:34.872072 tst cs_paging_gprs_active.py: using LAC 39366 07:31:35.001678 tst cs_paging_gprs_active.py: using RAC 96 07:31:35.125247 tst cs_paging_gprs_active.py: using CellId 39366 07:31:35.245171 tst cs_paging_gprs_active.py: using BVCI 39367 07:31:35.357214 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:35.368257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:35.379131 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:35.390278 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:35.401089 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:35.411924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:35.422869 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:35.433689 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:35.444706 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:31:35.566447 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:31:35.685378 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:31:35.893141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:31:36.203337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22949): Launched 07:31:36.471932 run iperf3-srv_10.42.42.10(pid=22950): Launched 07:31:36.587771 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:31:36.794128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:31:37.102080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22951): Launched 07:31:37.373409 run iperf3-srv_10.42.42.10(pid=22952): Launched 07:31:37.489288 tst cs_paging_gprs_active.py:38: start network... 07:31:37.695509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:38.171610 run create_hlr_db(pid=22953): Launched 07:31:38.298402 bus /gobi_6: Setting Powered False 07:31:39.358914 run create_hlr_db(pid=22953): Terminated: ok {rc=0} 07:31:39.786075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22955): Launched 07:31:40.094070 run osmo-hlr_10.42.42.2(pid=22956): Launched 07:31:40.210170 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:40.780012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22958): Launched 07:31:41.111968 run osmo-stp_10.42.42.5(pid=22959): Launched 07:31:41.238084 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:31:41.805797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22961): Launched 07:31:41.932832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:31:42.212688 run patchelf(pid=22962): Launched 07:31:42.396179 run osmo-stp_10.42.42.5(pid=22959): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22959)] 07:31:42.536016 run osmo-stp_10.42.42.5(pid=22959): stdout: | (launched: 2022-12-14_07:31:41.051760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:42.676341 run osmo-stp_10.42.42.5(pid=22959): stderr: | 20221214073141240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073141240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073141240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073141241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073141241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073141241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073141242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:42.816502 run osmo-stp_10.42.42.5(pid=22959): stdout: | (launched: 2022-12-14_07:31:41.051760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:42.951092 run osmo-stp_10.42.42.5(pid=22959): stderr: | 20221214073141240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073141240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073141240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073141241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073141241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073141241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073141242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:43.110318 run patchelf(pid=22962): Terminating (SIGINT) 07:31:43.295549 run patchelf(pid=22962): Terminated: ok {rc=0} 07:31:43.429672 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=22959): Process ended prematurely: osmo-stp_10.42.42.5(pid=22959) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22959)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:31:43.439923 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:31:43.468412 run osmo-hlr_10.42.42.2(pid=22956): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22956)] 07:31:43.519239 run osmo-hlr_10.42.42.2(pid=22956): stdout: | (launched: 2022-12-14_07:31:40.037417) 07:31:43.570995 run osmo-hlr_10.42.42.2(pid=22956): stderr: | 20221214073140211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073140211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073140211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073140211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073140211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073140211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073140224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073140232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073140232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073140232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:43.623000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22949): Terminating (SIGTERM) 07:31:43.665797 run iperf3-srv_10.42.42.10(pid=22950): Terminating (SIGTERM) 07:31:43.707976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22951): Terminating (SIGTERM) 07:31:43.750621 run iperf3-srv_10.42.42.10(pid=22952): Terminating (SIGTERM) 07:31:43.792458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22955): Terminating (SIGTERM) 07:31:43.834889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22958): Terminating (SIGTERM) 07:31:43.877149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22961): Terminating (SIGTERM) 07:31:43.919811 --- ParallelTerminationStrategy: PID 22949 died... 07:31:43.940049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22949): Terminated: ok {rc=0} 07:31:43.986492 --- ParallelTerminationStrategy: PID 22950 died... 07:31:44.006101 run iperf3-srv_10.42.42.10(pid=22950): Terminated {rc=256} 07:31:44.052170 --- ParallelTerminationStrategy: PID 22951 died... 07:31:44.071983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22951): Terminated: ok {rc=0} 07:31:44.118490 --- ParallelTerminationStrategy: PID 22952 died... 07:31:44.138335 run iperf3-srv_10.42.42.10(pid=22952): Terminated {rc=256} 07:31:44.184352 --- ParallelTerminationStrategy: PID 22955 died... 07:31:44.204130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22955): Terminated: ok {rc=0} 07:31:44.250383 --- ParallelTerminationStrategy: PID 22958 died... 07:31:44.270167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22958): Terminated: ok {rc=0} 07:31:44.316118 --- ParallelTerminationStrategy: PID 22961 died... 07:31:44.335822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22961): Terminated: ok {rc=0} 07:31:44.424713 bus /gobi_0: Setting Powered False 07:31:45.523336 bus /gobi_0: Setting Powered False 07:31:46.662553 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:31:47.825179 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:47.837580 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:31:47.914134 tst iperf3.py: using LAC 39367 07:31:48.043745 tst iperf3.py: using RAC 97 07:31:48.174287 tst iperf3.py: using CellId 39367 07:31:48.302627 tst iperf3.py: using BVCI 39368 07:31:48.423700 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:48.435692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:48.447207 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:48.458645 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:48.470335 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:48.482167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:48.493977 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:48.505559 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:48.517490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:31:48.635212 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:31:48.842673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:31:49.151312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22963): Launched 07:31:49.421807 run iperf3-srv_10.42.42.10(pid=22964): Launched 07:31:49.538364 tst iperf3.py:8: start network... 07:31:49.746289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:50.224702 run create_hlr_db(pid=22965): Launched 07:31:50.353460 bus /gobi_6: Setting Powered False 07:31:51.418373 run create_hlr_db(pid=22965): Terminated: ok {rc=0} 07:31:51.875862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22967): Launched 07:31:52.206270 run osmo-hlr_10.42.42.2(pid=22968): Launched 07:31:52.331762 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:52.901151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22970): Launched 07:31:53.231579 run osmo-stp_10.42.42.5(pid=22971): Launched 07:31:53.357726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:31:53.925519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22973): Launched 07:31:54.053220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:31:54.332901 run patchelf(pid=22974): Launched 07:31:54.517381 run osmo-stp_10.42.42.5(pid=22971): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22971)] 07:31:54.656218 run osmo-stp_10.42.42.5(pid=22971): stdout: | (launched: 2022-12-14_07:31:53.170943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:54.797294 run osmo-stp_10.42.42.5(pid=22971): stderr: | 20221214073153360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073153360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073153360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073153361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073153361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073153361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073153361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:54.938384 run osmo-stp_10.42.42.5(pid=22971): stdout: | (launched: 2022-12-14_07:31:53.170943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:55.073043 run osmo-stp_10.42.42.5(pid=22971): stderr: | 20221214073153360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073153360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073153360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073153361 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073153361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073153361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073153361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:55.232642 run patchelf(pid=22974): Terminating (SIGINT) 07:31:55.418186 run patchelf(pid=22974): Terminated: ok {rc=0} 07:31:55.552820 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22971): Process ended prematurely: osmo-stp_10.42.42.5(pid=22971) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22971)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 07:31:55.563066 tst iperf3.py:8: Test FAILED (7.8 sec) 07:31:55.591703 run osmo-hlr_10.42.42.2(pid=22968): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22968)] 07:31:55.642514 run osmo-hlr_10.42.42.2(pid=22968): stdout: | (launched: 2022-12-14_07:31:52.146361) 07:31:55.695088 run osmo-hlr_10.42.42.2(pid=22968): stderr: | 20221214073152340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073152340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073152340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073152340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073152340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073152340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073152353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073152362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073152362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073152362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:55.747958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22963): Terminating (SIGTERM) 07:31:55.789888 run iperf3-srv_10.42.42.10(pid=22964): Terminating (SIGTERM) 07:31:55.832380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22967): Terminating (SIGTERM) 07:31:55.875066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22970): Terminating (SIGTERM) 07:31:55.917191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22973): Terminating (SIGTERM) 07:31:55.959455 --- ParallelTerminationStrategy: PID 22963 died... 07:31:55.979919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22963): Terminated: ok {rc=0} 07:31:56.026634 --- ParallelTerminationStrategy: PID 22964 died... 07:31:56.046334 run iperf3-srv_10.42.42.10(pid=22964): Terminated {rc=256} 07:31:56.092562 --- ParallelTerminationStrategy: PID 22967 died... 07:31:56.112391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22967): Terminated: ok {rc=0} 07:31:56.158486 --- ParallelTerminationStrategy: PID 22970 died... 07:31:56.178274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22970): Terminated: ok {rc=0} 07:31:56.224484 --- ParallelTerminationStrategy: PID 22973 died... 07:31:56.244563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22973): Terminated: ok {rc=0} 07:31:56.333500 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:31:57.485052 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:57.497645 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:31:57.572147 tst iperf3m4.py: using LAC 39368 07:31:57.702613 tst iperf3m4.py: using RAC 98 07:31:57.833377 tst iperf3m4.py: using CellId 39368 07:31:57.963177 tst iperf3m4.py: using BVCI 39369 07:31:58.085048 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:58.097118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:58.108495 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:58.120145 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:58.131969 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:58.143793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:58.155719 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:58.167459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:31:58.179481 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:31:58.299463 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:31:58.425343 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:31:58.542165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:31:58.664248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:31:58.872510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:31:59.183322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22975): Launched 07:31:59.452688 run iperf3-srv_10.42.42.10(pid=22976): Launched 07:31:59.568707 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:31:59.774316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:32:00.083359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22977): Launched 07:32:00.351699 run iperf3-srv_10.42.42.10(pid=22978): Launched 07:32:00.467208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:32:00.672565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:32:01.010274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22979): Launched 07:32:01.292939 run iperf3-srv_10.42.42.10(pid=22980): Launched 07:32:01.435284 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:32:01.670398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:32:02.011884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22981): Launched 07:32:02.320132 run iperf3-srv_10.42.42.10(pid=22982): Launched 07:32:02.445947 tst iperf3m4.py:8: start network... 07:32:02.669474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:03.185595 run create_hlr_db(pid=22983): Launched 07:32:03.312801 bus /gobi_6: Setting Powered False 07:32:04.377515 run create_hlr_db(pid=22983): Terminated: ok {rc=0} 07:32:04.817420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22985): Launched 07:32:05.130251 run osmo-hlr_10.42.42.2(pid=22986): Launched 07:32:05.246762 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:05.776509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22988): Launched 07:32:06.083827 run osmo-stp_10.42.42.5(pid=22989): Launched 07:32:06.199950 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:32:06.728378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22991): Launched 07:32:06.846469 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:32:07.106805 run patchelf(pid=22992): Launched 07:32:07.279703 run osmo-stp_10.42.42.5(pid=22989): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22989)] 07:32:07.409377 run osmo-stp_10.42.42.5(pid=22989): stdout: | (launched: 2022-12-14_07:32:06.026936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:07.540820 run osmo-stp_10.42.42.5(pid=22989): stderr: | 20221214073206195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073206195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073206196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073206196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073206197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073206197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073206197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:07.671761 run osmo-stp_10.42.42.5(pid=22989): stdout: | (launched: 2022-12-14_07:32:06.026936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:07.796777 run osmo-stp_10.42.42.5(pid=22989): stderr: | 20221214073206195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073206195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073206196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073206196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073206197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073206197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073206197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:07.945167 run patchelf(pid=22992): Terminating (SIGINT) 07:32:08.118644 run patchelf(pid=22992): Terminated: ok {rc=0} 07:32:08.243895 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=22989): Process ended prematurely: osmo-stp_10.42.42.5(pid=22989) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22989)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:32:08.253744 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:32:08.281037 run osmo-hlr_10.42.42.2(pid=22986): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22986)] 07:32:08.328842 run osmo-hlr_10.42.42.2(pid=22986): stdout: | (launched: 2022-12-14_07:32:05.073113) 07:32:08.378274 run osmo-hlr_10.42.42.2(pid=22986): stderr: | 20221214073205247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073205247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073205247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073205247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073205247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073205247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073205260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073205268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073205268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073205268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:08.428025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22975): Terminating (SIGTERM) 07:32:08.468247 run iperf3-srv_10.42.42.10(pid=22976): Terminating (SIGTERM) 07:32:08.508161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22977): Terminating (SIGTERM) 07:32:08.547979 run iperf3-srv_10.42.42.10(pid=22978): Terminating (SIGTERM) 07:32:08.587744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22979): Terminating (SIGTERM) 07:32:08.627587 run iperf3-srv_10.42.42.10(pid=22980): Terminating (SIGTERM) 07:32:08.667212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22981): Terminating (SIGTERM) 07:32:08.706886 run iperf3-srv_10.42.42.10(pid=22982): Terminating (SIGTERM) 07:32:08.746483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22985): Terminating (SIGTERM) 07:32:08.786326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22988): Terminating (SIGTERM) 07:32:08.826177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22991): Terminating (SIGTERM) 07:32:08.866263 --- ParallelTerminationStrategy: PID 22975 died... 07:32:08.884830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22975): Terminated: ok {rc=0} 07:32:08.929093 --- ParallelTerminationStrategy: PID 22976 died... 07:32:08.947592 run iperf3-srv_10.42.42.10(pid=22976): Terminated {rc=256} 07:32:08.992050 --- ParallelTerminationStrategy: PID 22977 died... 07:32:09.010768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22977): Terminated: ok {rc=0} 07:32:09.054551 --- ParallelTerminationStrategy: PID 22978 died... 07:32:09.073050 run iperf3-srv_10.42.42.10(pid=22978): Terminated {rc=256} 07:32:09.116599 --- ParallelTerminationStrategy: PID 22979 died... 07:32:09.135158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22979): Terminated: ok {rc=0} 07:32:09.178925 --- ParallelTerminationStrategy: PID 22980 died... 07:32:09.197537 run iperf3-srv_10.42.42.10(pid=22980): Terminated {rc=256} 07:32:09.241335 --- ParallelTerminationStrategy: PID 22981 died... 07:32:09.259916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=22981): Terminated: ok {rc=0} 07:32:09.303821 --- ParallelTerminationStrategy: PID 22982 died... 07:32:09.322480 run iperf3-srv_10.42.42.10(pid=22982): Terminated {rc=256} 07:32:09.366106 --- ParallelTerminationStrategy: PID 22985 died... 07:32:09.384884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22985): Terminated: ok {rc=0} 07:32:09.428882 --- ParallelTerminationStrategy: PID 22988 died... 07:32:09.447924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22988): Terminated: ok {rc=0} 07:32:09.491656 --- ParallelTerminationStrategy: PID 22991 died... 07:32:09.510422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=22991): Terminated: ok {rc=0} 07:32:09.596231 bus /gobi_4: Setting Powered False 07:32:10.696568 bus /gobi_4: Setting Powered False 07:32:11.812665 bus /gobi_1: Setting Powered False 07:32:12.911737 bus /gobi_1: Setting Powered False 07:32:14.026348 bus /gobi_0: Setting Powered False 07:32:15.123644 bus /gobi_0: Setting Powered False 07:32:16.254414 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:32:17.366693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:17.379020 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:32:17.453533 tst ping.py: using LAC 39369 07:32:17.572175 tst ping.py: using RAC 99 07:32:17.690445 tst ping.py: using CellId 39369 07:32:17.809089 tst ping.py: using BVCI 39370 07:32:17.917952 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:17.929257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:17.940090 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:17.950986 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:17.961854 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:17.972791 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:17.983840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:17.994721 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:32:18.115977 tst ping.py:19: start network... 07:32:18.334066 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:18.833804 run create_hlr_db(pid=22993): Launched 07:32:18.958634 bus /gobi_6: Setting Powered False 07:32:20.022620 run create_hlr_db(pid=22993): Terminated: ok {rc=0} 07:32:20.474415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22995): Launched 07:32:20.798958 run osmo-hlr_10.42.42.2(pid=22996): Launched 07:32:20.923634 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:21.493228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22998): Launched 07:32:21.815659 run osmo-stp_10.42.42.5(pid=22999): Launched 07:32:21.938584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:32:22.493548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23001): Launched 07:32:22.618376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:32:22.891828 run patchelf(pid=23002): Launched 07:32:23.071009 run osmo-stp_10.42.42.5(pid=22999): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22999)] 07:32:23.207638 run osmo-stp_10.42.42.5(pid=22999): stdout: | (launched: 2022-12-14_07:32:21.756595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:23.345744 run osmo-stp_10.42.42.5(pid=22999): stderr: | 20221214073221946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073221947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073221947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073221947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073221948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073221948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073221948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:23.483877 run osmo-stp_10.42.42.5(pid=22999): stdout: | (launched: 2022-12-14_07:32:21.756595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:23.615246 run osmo-stp_10.42.42.5(pid=22999): stderr: | 20221214073221946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073221947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073221947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073221947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073221948 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073221948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073221948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:23.770496 run patchelf(pid=23002): Terminating (SIGINT) 07:32:23.951900 run patchelf(pid=23002): Terminated: ok {rc=0} 07:32:24.083047 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=22999): Process ended prematurely: osmo-stp_10.42.42.5(pid=22999) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22999)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 07:32:24.092522 tst ping.py:22: Test FAILED (6.7 sec) 07:32:24.120615 run osmo-hlr_10.42.42.2(pid=22996): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=22996)] 07:32:24.170830 run osmo-hlr_10.42.42.2(pid=22996): stdout: | (launched: 2022-12-14_07:32:20.740099) 07:32:24.222734 run osmo-hlr_10.42.42.2(pid=22996): stderr: | 20221214073220934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073220934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073220934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073220934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073220934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073220934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073220946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073220954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073220954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073220954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:24.275050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22995): Terminating (SIGTERM) 07:32:24.316830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22998): Terminating (SIGTERM) 07:32:24.359337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23001): Terminating (SIGTERM) 07:32:24.401543 --- ParallelTerminationStrategy: PID 22995 died... 07:32:24.421840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22995): Terminated: ok {rc=0} 07:32:24.468732 --- ParallelTerminationStrategy: PID 22998 died... 07:32:24.488614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22998): Terminated: ok {rc=0} 07:32:24.534795 --- ParallelTerminationStrategy: PID 23001 died... 07:32:24.554516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23001): Terminated: ok {rc=0} 07:32:24.642742 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:32:25.729155 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:25.741499 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:32:25.816242 tst ping_idle_ping.py: using LAC 39370 07:32:25.944006 tst ping_idle_ping.py: using RAC 100 07:32:26.077030 tst ping_idle_ping.py: using CellId 39370 07:32:26.202293 tst ping_idle_ping.py: using BVCI 39371 07:32:26.319788 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:26.331386 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:26.342832 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:26.354338 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:26.366015 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:26.377710 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:26.389614 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:32:26.401254 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:32:26.518816 tst ping_idle_ping.py:24: start network... 07:32:26.721654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:27.192407 run create_hlr_db(pid=23003): Launched 07:32:27.317833 bus /gobi_6: Setting Powered False 07:32:28.378070 run create_hlr_db(pid=23003): Terminated: ok {rc=0} 07:32:28.822236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23005): Launched 07:32:29.147791 run osmo-hlr_10.42.42.2(pid=23006): Launched 07:32:29.271342 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:29.831588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23008): Launched 07:32:30.158363 run osmo-stp_10.42.42.5(pid=23009): Launched 07:32:30.281641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:32:30.852049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23011): Launched 07:32:30.984521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:32:31.253861 run patchelf(pid=23012): Launched 07:32:31.443654 run osmo-stp_10.42.42.5(pid=23009): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23009)] 07:32:31.585968 run osmo-stp_10.42.42.5(pid=23009): stdout: | (launched: 2022-12-14_07:32:30.098807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:31.729165 run osmo-stp_10.42.42.5(pid=23009): stderr: | 20221214073230287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073230288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073230288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073230288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073230289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073230289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073230289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:31.872452 run osmo-stp_10.42.42.5(pid=23009): stdout: | (launched: 2022-12-14_07:32:30.098807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:32.009071 run osmo-stp_10.42.42.5(pid=23009): stderr: | 20221214073230287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073230288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073230288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073230288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073230289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073230289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073230289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:32.170971 run patchelf(pid=23012): Terminating (SIGINT) 07:32:32.355258 run patchelf(pid=23012): Terminated: ok {rc=0} 07:32:32.487857 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23009): Process ended prematurely: osmo-stp_10.42.42.5(pid=23009) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23009)] [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:32:32.497770 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:32:32.526093 run osmo-hlr_10.42.42.2(pid=23006): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23006)] 07:32:32.577423 run osmo-hlr_10.42.42.2(pid=23006): stdout: | (launched: 2022-12-14_07:32:29.088252) 07:32:32.630358 run osmo-hlr_10.42.42.2(pid=23006): stderr: | 20221214073229282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073229282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073229282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073229282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073229282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073229282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073229295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073229305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073229305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073229305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:32.683380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23005): Terminating (SIGTERM) 07:32:32.725602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23008): Terminating (SIGTERM) 07:32:32.768476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23011): Terminating (SIGTERM) 07:32:32.811205 --- ParallelTerminationStrategy: PID 23005 died... 07:32:32.831868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23005): Terminated: ok {rc=0} 07:32:32.879001 --- ParallelTerminationStrategy: PID 23008 died... 07:32:32.899002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23008): Terminated: ok {rc=0} 07:32:32.945481 --- ParallelTerminationStrategy: PID 23011 died... 07:32:32.965425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23011): Terminated: ok {rc=0} 07:32:33.054774 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:32:34.360678 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:32:34.367853 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:32:34.402280 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:32:34.437231 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:32:34.491605 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:32:34.526505 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:32:34.562084 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:32:35.120201 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:32:35.125899 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:32:35.137791 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:32:35.212402 tst switch_tch_pdch.py: using LAC 39371 07:32:35.331798 tst switch_tch_pdch.py: using RAC 101 07:32:35.451563 tst switch_tch_pdch.py: using CellId 39371 07:32:35.579875 tst switch_tch_pdch.py: using BVCI 39372 07:32:35.690404 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:32:35.701961 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:32:35.713310 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:32:35.724625 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:32:35.736020 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:32:35.747314 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:32:35.758628 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:32:35.769927 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:32:35.891122 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:32:36.010009 tst switch_tch_pdch.py:51: start network... 07:32:36.227620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:36.727626 run create_hlr_db(pid=23016): Launched 07:32:36.851251 bus /gobi_6: Setting Powered False 07:32:37.914555 run create_hlr_db(pid=23016): Terminated: ok {rc=0} 07:32:38.365235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23018): Launched 07:32:38.688869 run osmo-hlr_10.42.42.2(pid=23019): Launched 07:32:38.813784 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:39.374339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23021): Launched 07:32:39.697411 run osmo-stp_10.42.42.5(pid=23022): Launched 07:32:39.822460 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:32:40.381722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23024): Launched 07:32:40.508489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:32:40.782338 run patchelf(pid=23025): Launched 07:32:40.963172 run osmo-stp_10.42.42.5(pid=23022): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23022)] 07:32:41.099354 run osmo-stp_10.42.42.5(pid=23022): stdout: | (launched: 2022-12-14_07:32:39.638576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:41.237810 run osmo-stp_10.42.42.5(pid=23022): stderr: | 20221214073239825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073239825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073239825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073239826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073239826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073239826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073239826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:41.376296 run osmo-stp_10.42.42.5(pid=23022): stdout: | (launched: 2022-12-14_07:32:39.638576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:41.508237 run osmo-stp_10.42.42.5(pid=23022): stderr: | 20221214073239825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073239825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073239825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073239826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073239826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073239826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073239826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:41.663980 run patchelf(pid=23025): Terminating (SIGINT) 07:32:41.845923 run patchelf(pid=23025): Terminated: ok {rc=0} 07:32:41.976836 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23022): Process ended prematurely: osmo-stp_10.42.42.5(pid=23022) [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23022)] [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:32:41.986705 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 07:32:42.014501 run osmo-hlr_10.42.42.2(pid=23019): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23019)] 07:32:42.065134 run osmo-hlr_10.42.42.2(pid=23019): stdout: | (launched: 2022-12-14_07:32:38.630182) 07:32:42.117284 run osmo-hlr_10.42.42.2(pid=23019): stderr: | 20221214073238821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073238821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073238821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073238821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073238821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073238821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073238833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073238841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073238842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073238842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:42.170063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23018): Terminating (SIGTERM) 07:32:42.212046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23021): Terminating (SIGTERM) 07:32:42.254957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23024): Terminating (SIGTERM) 07:32:42.297206 --- ParallelTerminationStrategy: PID 23018 died... 07:32:42.317497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23018): Terminated: ok {rc=0} 07:32:42.363929 --- ParallelTerminationStrategy: PID 23021 died... 07:32:42.383864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23021): Terminated: ok {rc=0} 07:32:42.430072 --- ParallelTerminationStrategy: PID 23024 died... 07:32:42.449888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23024): Terminated: ok {rc=0} 07:32:42.538857 bus /gobi_0: Setting Powered False 07:32:43.638021 bus /gobi_0: Setting Powered False 07:32:44.753851 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:32:46.036699 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:32:46.043389 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:32:46.078701 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:32:46.114636 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:32:46.167491 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:32:46.210846 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:32:46.261089 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:32:46.822865 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:32:46.831403 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:32:46.847973 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:32:46.938650 tst switch_tch_pdch.py: using LAC 39372 07:32:47.068244 tst switch_tch_pdch.py: using RAC 102 07:32:47.214375 tst switch_tch_pdch.py: using CellId 39372 07:32:47.361082 tst switch_tch_pdch.py: using BVCI 39373 07:32:47.480105 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:32:47.492768 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:32:47.504517 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:32:47.516022 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:32:47.528043 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:32:47.540299 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:32:47.552198 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:32:47.564167 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:32:47.683523 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:32:47.804170 tst switch_tch_pdch.py:51: start network... 07:32:48.022729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:48.495012 run create_hlr_db(pid=23029): Launched 07:32:48.619943 bus /gobi_6: Setting Powered False 07:32:49.684444 run create_hlr_db(pid=23029): Terminated: ok {rc=0} 07:32:50.091317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23031): Launched 07:32:50.394306 run osmo-hlr_10.42.42.2(pid=23032): Launched 07:32:50.509128 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:51.002911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23034): Launched 07:32:51.303124 run osmo-stp_10.42.42.5(pid=23035): Launched 07:32:51.418742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:32:51.911955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23037): Launched 07:32:52.037960 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:32:52.311324 run patchelf(pid=23038): Launched 07:32:52.493227 run osmo-stp_10.42.42.5(pid=23035): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23035)] 07:32:52.630009 run osmo-stp_10.42.42.5(pid=23035): stdout: | (launched: 2022-12-14_07:32:51.247648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:52.768497 run osmo-stp_10.42.42.5(pid=23035): stderr: | 20221214073251412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073251412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073251413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073251413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073251413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073251414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073251414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:52.906820 run osmo-stp_10.42.42.5(pid=23035): stdout: | (launched: 2022-12-14_07:32:51.247648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:53.038913 run osmo-stp_10.42.42.5(pid=23035): stderr: | 20221214073251412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073251412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073251413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073251413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073251413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073251414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073251414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:53.195515 run patchelf(pid=23038): Terminating (SIGINT) 07:32:53.378829 run patchelf(pid=23038): Terminated: ok {rc=0} 07:32:53.511142 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23035): Process ended prematurely: osmo-stp_10.42.42.5(pid=23035) [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23035)] [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:32:53.520598 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:32:53.549074 run osmo-hlr_10.42.42.2(pid=23032): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23032)] 07:32:53.599754 run osmo-hlr_10.42.42.2(pid=23032): stdout: | (launched: 2022-12-14_07:32:50.339098) 07:32:53.651739 run osmo-hlr_10.42.42.2(pid=23032): stderr: | 20221214073250510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073250511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073250511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073250511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073250511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073250511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073250523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073250533 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073250534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073250534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:53.704803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23031): Terminating (SIGTERM) 07:32:53.747010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23034): Terminating (SIGTERM) 07:32:53.789883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23037): Terminating (SIGTERM) 07:32:53.832581 --- ParallelTerminationStrategy: PID 23031 died... 07:32:53.853062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23031): Terminated: ok {rc=0} 07:32:53.899713 --- ParallelTerminationStrategy: PID 23034 died... 07:32:53.919577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23034): Terminated: ok {rc=0} 07:32:53.966145 --- ParallelTerminationStrategy: PID 23037 died... 07:32:53.986067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23037): Terminated: ok {rc=0} 07:32:54.075063 bus /gobi_0: Setting Powered False 07:32:55.173044 bus /gobi_0: Setting Powered False 07:32:56.289459 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_sms:trx-umtrx --------------------------------------------------------------------- 07:32:57.547969 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:32:57.552079 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:32:57.584777 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 07:32:57.592613 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 07:32:57.646307 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:32:57.678791 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 07:32:57.685999 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 07:32:58.224303 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 07:32:58.229546 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 07:32:58.240486 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 07:32:58.294584 tst mo_mt_sms.py: using LAC 39373 07:32:58.420638 tst mo_mt_sms.py: using RAC 103 07:32:58.549189 tst mo_mt_sms.py: using CellId 39373 07:32:58.685457 tst mo_mt_sms.py: using BVCI 39374 07:32:58.795538 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:32:58.915840 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:32:59.031432 tst mo_mt_sms.py:9: start nitb and bts... 07:32:59.234878 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:32:59.850778 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23043): Launched 07:33:00.152344 run osmo-nitb_10.42.42.2(pid=23044): Launched 07:33:00.319662 run osmo-nitb_10.42.42.2(pid=23044): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23044)] 07:33:00.454808 run osmo-nitb_10.42.42.2(pid=23044): stdout: | (launched: 2022-12-14_07:33:00.097076) 07:33:00.591707 run osmo-nitb_10.42.42.2(pid=23044): stderr: | (launched: 2022-12-14_07:33:00.141791) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:33:00.728183 run osmo-nitb_10.42.42.2(pid=23044): stdout: | (launched: 2022-12-14_07:33:00.097076) 07:33:00.873148 run osmo-nitb_10.42.42.2(pid=23044): stderr: | (launched: 2022-12-14_07:33:00.141791) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23044): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23044) [trial-2401↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23044)] 07:33:01.266408 tst osmo-nitb_10.42.42.2(pid=23044): stdout: | (launched: 2022-12-14_07:33:00.097076) 07:33:01.438405 tst osmo-nitb_10.42.42.2(pid=23044): stderr: | (launched: 2022-12-14_07:33:00.141791) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:33:01.602036 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23044): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23044) [trial-2401↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23044)] [trial-2401↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 07:33:01.612433 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:33:01.620711 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23043): Terminating (SIGTERM) 07:33:01.836573 --- ParallelTerminationStrategy: PID 23043 died... 07:33:01.858577 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23043): Terminated: ok {rc=0} 07:33:01.951951 bus /sierra_3: Setting Powered False 07:33:03.051343 bus /sierra_3: Setting Powered False 07:33:04.167466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 sms:trx-umtrx --------------------------------------------------------------------- 07:33:05.363905 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:05.367865 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:33:05.400000 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 07:33:05.427059 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 07:33:05.479646 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:33:05.513045 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 07:33:05.540610 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 07:33:06.087879 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 07:33:06.093249 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:06.104377 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 07:33:06.156365 tst mo_mt_sms.py: using LAC 39374 07:33:06.282477 tst mo_mt_sms.py: using RAC 104 07:33:06.408655 tst mo_mt_sms.py: using CellId 39374 07:33:06.533393 tst mo_mt_sms.py: using BVCI 39375 07:33:06.650055 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:06.661278 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:06.672262 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:06.683247 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:06.694630 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:06.705886 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:33:06.823044 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:33:06.944234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:07.412165 run create_hlr_db(pid=23051): Launched 07:33:07.537192 bus /sierra_2: Setting Powered False 07:33:08.597620 run create_hlr_db(pid=23051): Terminated: ok {rc=0} 07:33:09.038715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23053): Launched 07:33:09.361739 run osmo-hlr_10.42.42.2(pid=23054): Launched 07:33:09.485594 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:10.044009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23056): Launched 07:33:10.368054 run osmo-stp_10.42.42.5(pid=23057): Launched 07:33:10.491784 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:11.076136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23059): Launched 07:33:11.399403 run osmo-msc_10.42.42.6(pid=23060): Launched 07:33:11.582687 run osmo-stp_10.42.42.5(pid=23057): ERR: Terminated: ERROR {rc=1} [trial-2401↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23057)] 07:33:11.718818 run osmo-stp_10.42.42.5(pid=23057): stdout: | (launched: 2022-12-14_07:33:10.308770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:11.855725 run osmo-stp_10.42.42.5(pid=23057): stderr: | 20221214073310497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073310497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073310498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073310498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073310499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073310499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073310499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:11.991164 run osmo-stp_10.42.42.5(pid=23057): stdout: | (launched: 2022-12-14_07:33:10.308770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:12.119833 run osmo-stp_10.42.42.5(pid=23057): stderr: | 20221214073310497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073310497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073310498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073310498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073310499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073310499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073310499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:12.273941 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23057): Process ended prematurely: osmo-stp_10.42.42.5(pid=23057) [trial-2401↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23057)] [trial-2401↪sms:trx-umtrx↪mo_mt_sms.py:16] 07:33:12.283211 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 07:33:12.310493 run osmo-hlr_10.42.42.2(pid=23054): ERR: Terminated: ERROR {rc=237} [trial-2401↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23054)] 07:33:12.361676 run osmo-hlr_10.42.42.2(pid=23054): stdout: | (launched: 2022-12-14_07:33:09.302794) 07:33:12.413799 run osmo-hlr_10.42.42.2(pid=23054): stderr: | 20221214073309496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073309496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073309496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073309496 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073309496 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073309496 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073309509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073309517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073309518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073309518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:12.486804 run osmo-msc_10.42.42.6(pid=23060): ERR: Terminated: ERROR {rc=2} [trial-2401↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23060)] 07:33:12.536770 run osmo-msc_10.42.42.6(pid=23060): stdout: | (launched: 2022-12-14_07:33:11.340362) 07:33:12.589068 run osmo-msc_10.42.42.6(pid=23060): stderr: | 20221214073311660 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073311660 DLGLOBAL DEBUG validating counter group 0x7fed52ea7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073311660 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073311661 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073311661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073311661 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073311663 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073311663 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073311664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073311664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:12.641379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23053): Terminating (SIGTERM) 07:33:12.683311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23056): Terminating (SIGTERM) 07:33:12.725629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23059): Terminating (SIGTERM) 07:33:12.768454 --- ParallelTerminationStrategy: PID 23053 died... 07:33:12.788902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23053): Terminated: ok {rc=0} 07:33:12.835571 --- ParallelTerminationStrategy: PID 23056 died... 07:33:12.855368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23056): Terminated: ok {rc=0} 07:33:12.901965 --- ParallelTerminationStrategy: PID 23059 died... 07:33:12.921643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23059): Terminated: ok {rc=0} 07:33:13.010366 bus /sierra_3: Setting Powered False 07:33:14.109918 bus /sierra_3: Setting Powered False 07:33:15.228499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 07:33:16.474807 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:16.480104 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:33:16.516335 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 07:33:16.525097 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 07:33:16.560742 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:33:16.599732 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 07:33:16.607815 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 07:33:17.129061 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 07:33:17.135999 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 07:33:17.151542 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 07:33:17.211943 tst assert_extension.py: using LAC 39375 07:33:17.346563 tst assert_extension.py: using RAC 105 07:33:17.475803 tst assert_extension.py: using CellId 39375 07:33:17.596727 tst assert_extension.py: using BVCI 39376 07:33:17.706562 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 07:33:17.826057 tst assert_extension.py:10: start nitb and bts... 07:33:18.044831 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:33:18.703630 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23066): Launched 07:33:19.025952 run osmo-nitb_10.42.42.2(pid=23067): Launched 07:33:19.204365 run osmo-nitb_10.42.42.2(pid=23067): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23067)] 07:33:19.348428 run osmo-nitb_10.42.42.2(pid=23067): stdout: | (launched: 2022-12-14_07:33:18.967275) 07:33:19.494237 run osmo-nitb_10.42.42.2(pid=23067): stderr: | (launched: 2022-12-14_07:33:19.014898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:33:19.640177 run osmo-nitb_10.42.42.2(pid=23067): stdout: | (launched: 2022-12-14_07:33:18.967275) 07:33:19.779251 run osmo-nitb_10.42.42.2(pid=23067): stderr: | (launched: 2022-12-14_07:33:19.014898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23067) [trial-2401↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23067)] 07:33:20.148043 tst osmo-nitb_10.42.42.2(pid=23067): stdout: | (launched: 2022-12-14_07:33:18.967275) 07:33:20.280079 tst osmo-nitb_10.42.42.2(pid=23067): stderr: | (launched: 2022-12-14_07:33:19.014898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:33:20.435340 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23067) [trial-2401↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23067)] [trial-2401↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 07:33:20.444384 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:33:20.451567 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23066): Terminating (SIGTERM) 07:33:20.664359 --- ParallelTerminationStrategy: PID 23066 died... 07:33:20.686116 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23066): Terminated: ok {rc=0} 07:33:20.777205 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 ussd:trx-umtrx --------------------------------------------------------------------- 07:33:21.951651 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:21.955927 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:33:21.988767 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 07:33:22.017491 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 07:33:22.053020 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:33:22.086054 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 07:33:22.112551 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 07:33:22.644031 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 07:33:22.649567 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:22.660773 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 07:33:22.709386 tst assert_extension.py: using LAC 39376 07:33:22.833738 tst assert_extension.py: using RAC 106 07:33:22.958419 tst assert_extension.py: using CellId 39376 07:33:23.082383 tst assert_extension.py: using BVCI 39377 07:33:23.200765 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:23.211904 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:23.222857 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:23.233880 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:23.245122 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:23.256243 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 07:33:23.375862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:23.875935 run create_hlr_db(pid=23071): Launched 07:33:23.998945 bus /sierra_2: Setting Powered False 07:33:25.062339 run create_hlr_db(pid=23071): Terminated: ok {rc=0} 07:33:25.495582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23073): Launched 07:33:25.799175 run osmo-hlr_10.42.42.2(pid=23074): Launched 07:33:25.914215 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:26.453618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23076): Launched 07:33:26.756013 run osmo-stp_10.42.42.5(pid=23077): Launched 07:33:26.869277 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:27.410944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23079): Launched 07:33:27.713704 run osmo-msc_10.42.42.6(pid=23080): Launched 07:33:27.882135 run osmo-stp_10.42.42.5(pid=23077): ERR: Terminated: ERROR {rc=1} [trial-2401↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23077)] 07:33:28.009239 run osmo-stp_10.42.42.5(pid=23077): stdout: | (launched: 2022-12-14_07:33:26.700513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:28.136442 run osmo-stp_10.42.42.5(pid=23077): stderr: | 20221214073326868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073326868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073326868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073326869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073326869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073326870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073326870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:28.261896 run osmo-stp_10.42.42.5(pid=23077): stdout: | (launched: 2022-12-14_07:33:26.700513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:28.381834 run osmo-stp_10.42.42.5(pid=23077): stderr: | 20221214073326868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073326868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073326868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073326869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073326869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073326870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073326870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:28.525819 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23077): Process ended prematurely: osmo-stp_10.42.42.5(pid=23077) [trial-2401↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23077)] [trial-2401↪ussd:trx-umtrx↪assert_extension.py:17] 07:33:28.534187 tst assert_extension.py:17: Test FAILED (5.9 sec) 07:33:28.560243 run osmo-hlr_10.42.42.2(pid=23074): ERR: Terminated: ERROR {rc=237} [trial-2401↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23074)] 07:33:28.607863 run osmo-hlr_10.42.42.2(pid=23074): stdout: | (launched: 2022-12-14_07:33:25.743915) 07:33:28.657323 run osmo-hlr_10.42.42.2(pid=23074): stderr: | 20221214073325918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073325918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073325918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073325918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073325918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073325918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073325930 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073325939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073325939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073325939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:28.726437 run osmo-msc_10.42.42.6(pid=23080): ERR: Terminated: ERROR {rc=2} [trial-2401↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23080)] 07:33:28.774030 run osmo-msc_10.42.42.6(pid=23080): stdout: | (launched: 2022-12-14_07:33:27.658552) 07:33:28.823331 run osmo-msc_10.42.42.6(pid=23080): stderr: | 20221214073327927 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073327927 DLGLOBAL DEBUG validating counter group 0x7f4eb0f1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073327927 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073327927 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073327927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073327927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073327929 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073327930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073327930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073327930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:28.873099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23073): Terminating (SIGTERM) 07:33:28.912919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23076): Terminating (SIGTERM) 07:33:28.953629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23079): Terminating (SIGTERM) 07:33:28.994152 --- ParallelTerminationStrategy: PID 23073 died... 07:33:29.013517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23073): Terminated: ok {rc=0} 07:33:29.057438 --- ParallelTerminationStrategy: PID 23076 died... 07:33:29.076081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23076): Terminated: ok {rc=0} 07:33:29.120102 --- ParallelTerminationStrategy: PID 23079 died... 07:33:29.138691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23079): Terminated: ok {rc=0} 07:33:29.222484 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:33:30.434063 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:30.441732 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:33:30.476336 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:33:30.503893 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:33:30.556713 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:33:30.589933 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:33:30.617255 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:33:31.173833 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:33:31.230839 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:31.243604 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:33:31.323966 tst mo_mt_call.py: using LAC 39377 07:33:31.460142 tst mo_mt_call.py: using RAC 107 07:33:31.592558 tst mo_mt_call.py: using CellId 39377 07:33:31.726617 tst mo_mt_call.py: using BVCI 39378 07:33:31.851343 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:31.865034 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:31.877665 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:31.892442 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:31.906213 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:31.919996 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:33:32.052400 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:33:32.177366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:32.692040 run create_hlr_db(pid=23085): Launched 07:33:32.818314 bus /sierra_2: Setting Powered False 07:33:33.883152 run create_hlr_db(pid=23085): Terminated: ok {rc=0} 07:33:34.322029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23087): Launched 07:33:34.629803 run osmo-hlr_10.42.42.2(pid=23088): Launched 07:33:34.747342 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:35.288747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23090): Launched 07:33:35.596768 run osmo-stp_10.42.42.5(pid=23091): Launched 07:33:35.715553 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:36.270514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23093): Launched 07:33:36.577497 run osmo-msc_10.42.42.6(pid=23094): Launched 07:33:36.754645 run osmo-stp_10.42.42.5(pid=23091): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23091)] 07:33:36.884639 run osmo-stp_10.42.42.5(pid=23091): stdout: | (launched: 2022-12-14_07:33:35.539704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:37.015701 run osmo-stp_10.42.42.5(pid=23091): stderr: | 20221214073335709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073335709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073335709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073335710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073335710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073335710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073335710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:37.144388 run osmo-stp_10.42.42.5(pid=23091): stdout: | (launched: 2022-12-14_07:33:35.539704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:37.266759 run osmo-stp_10.42.42.5(pid=23091): stderr: | 20221214073335709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073335709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073335709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073335710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073335710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073335710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073335710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:37.413470 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23091): Process ended prematurely: osmo-stp_10.42.42.5(pid=23091) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23091)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:33:37.422554 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:33:37.449112 run osmo-hlr_10.42.42.2(pid=23088): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23088)] 07:33:37.497184 run osmo-hlr_10.42.42.2(pid=23088): stdout: | (launched: 2022-12-14_07:33:34.573567) 07:33:37.546970 run osmo-hlr_10.42.42.2(pid=23088): stderr: | 20221214073334746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073334746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073334746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073334746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073334746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073334747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073334759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073334767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073334767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073334767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:37.616412 run osmo-msc_10.42.42.6(pid=23094): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23094)] 07:33:37.664229 run osmo-msc_10.42.42.6(pid=23094): stdout: | (launched: 2022-12-14_07:33:36.521119) 07:33:37.714688 run osmo-msc_10.42.42.6(pid=23094): stderr: | 20221214073336791 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073336791 DLGLOBAL DEBUG validating counter group 0x7f1f8af29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073336791 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073336791 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073336792 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073336792 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073336794 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073336794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073336794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073336794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:37.764532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23087): Terminating (SIGTERM) 07:33:37.804261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23090): Terminating (SIGTERM) 07:33:37.844065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23093): Terminating (SIGTERM) 07:33:37.884047 --- ParallelTerminationStrategy: PID 23087 died... 07:33:37.903466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23087): Terminated: ok {rc=0} 07:33:37.947589 --- ParallelTerminationStrategy: PID 23090 died... 07:33:37.966198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23090): Terminated: ok {rc=0} 07:33:38.010327 --- ParallelTerminationStrategy: PID 23093 died... 07:33:38.029226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23093): Terminated: ok {rc=0} 07:33:38.115653 bus /sierra_3: Setting Powered False 07:33:39.216672 bus /sierra_3: Setting Powered False 07:33:40.334456 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:33:41.485746 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:41.498342 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:33:41.570588 tst mo_mt_call_osmux.py: using LAC 39378 07:33:41.701378 tst mo_mt_call_osmux.py: using RAC 108 07:33:41.830982 tst mo_mt_call_osmux.py: using CellId 39378 07:33:41.962707 tst mo_mt_call_osmux.py: using BVCI 39379 07:33:42.083679 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:42.095313 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:42.106680 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:42.118178 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:42.129984 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:33:42.141661 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:33:42.263595 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:33:42.381696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:42.857290 run create_hlr_db(pid=23096): Launched 07:33:42.983060 bus /sierra_2: Setting Powered False 07:33:44.043608 run create_hlr_db(pid=23096): Terminated: ok {rc=0} 07:33:44.470114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23098): Launched 07:33:44.776430 run osmo-hlr_10.42.42.2(pid=23099): Launched 07:33:44.892172 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:45.422060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23101): Launched 07:33:45.728916 run osmo-stp_10.42.42.5(pid=23102): Launched 07:33:45.902241 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:46.524293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23104): Launched 07:33:46.942759 run osmo-msc_10.42.42.6(pid=23105): Launched 07:33:47.378224 run osmo-stp_10.42.42.5(pid=23102): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23102)] 07:33:47.573660 run osmo-stp_10.42.42.5(pid=23102): stdout: | (launched: 2022-12-14_07:33:45.672590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:47.713748 run osmo-stp_10.42.42.5(pid=23102): stderr: | 20221214073345840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073345840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073345840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073345841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073345841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073345841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073345841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:47.851845 run osmo-stp_10.42.42.5(pid=23102): stdout: | (launched: 2022-12-14_07:33:45.672590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:47.982792 run osmo-stp_10.42.42.5(pid=23102): stderr: | 20221214073345840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073345840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073345840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073345841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073345841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073345841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073345841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:48.139340 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23102): Process ended prematurely: osmo-stp_10.42.42.5(pid=23102) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23102)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:33:48.149327 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 07:33:48.177375 run osmo-hlr_10.42.42.2(pid=23099): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23099)] 07:33:48.228225 run osmo-hlr_10.42.42.2(pid=23099): stdout: | (launched: 2022-12-14_07:33:44.720096) 07:33:48.280516 run osmo-hlr_10.42.42.2(pid=23099): stderr: | 20221214073344893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073344893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073344893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073344893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073344893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073344893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073344910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073344920 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073344920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073344920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:48.353211 run osmo-msc_10.42.42.6(pid=23105): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23105)] 07:33:48.403354 run osmo-msc_10.42.42.6(pid=23105): stdout: | (launched: 2022-12-14_07:33:46.884059) 07:33:48.455736 run osmo-msc_10.42.42.6(pid=23105): stderr: | 20221214073347382 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073347382 DLGLOBAL DEBUG validating counter group 0x7f25e5da8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073347382 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073347382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073347382 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073347383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073347384 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073347385 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073347385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073347385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:48.508583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23098): Terminating (SIGTERM) 07:33:48.550501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23101): Terminating (SIGTERM) 07:33:48.592913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23104): Terminating (SIGTERM) 07:33:48.635427 --- ParallelTerminationStrategy: PID 23098 died... 07:33:48.655923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23098): Terminated: ok {rc=0} 07:33:48.703018 --- ParallelTerminationStrategy: PID 23101 died... 07:33:48.722953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23101): Terminated: ok {rc=0} 07:33:48.769287 --- ParallelTerminationStrategy: PID 23104 died... 07:33:48.788995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23104): Terminated: ok {rc=0} 07:33:48.877858 bus /sierra_3: Setting Powered False 07:33:49.976725 bus /sierra_3: Setting Powered False 07:33:51.094079 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:33:52.340459 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:52.346959 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:33:52.379018 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:33:52.405859 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:33:52.459768 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:33:52.493352 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:33:52.521822 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:33:53.069734 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:33:53.123951 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:33:53.135569 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:33:53.206947 tst mo_mt_call.py: using LAC 39379 07:33:53.336028 tst mo_mt_call.py: using RAC 109 07:33:53.465044 tst mo_mt_call.py: using CellId 39379 07:33:53.594268 tst mo_mt_call.py: using BVCI 39380 07:33:53.715605 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:33:53.727186 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:33:53.738561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:33:53.749923 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:33:53.762185 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:33:53.774354 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:33:53.893371 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:33:54.015350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:54.525811 run create_hlr_db(pid=23110): Launched 07:33:54.652391 bus /sierra_2: Setting Powered False 07:33:55.717281 run create_hlr_db(pid=23110): Terminated: ok {rc=0} 07:33:56.156711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23112): Launched 07:33:56.464727 run osmo-hlr_10.42.42.2(pid=23113): Launched 07:33:56.582622 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:57.115238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23115): Launched 07:33:57.423445 run osmo-stp_10.42.42.5(pid=23116): Launched 07:33:57.540204 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:58.096861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23118): Launched 07:33:58.404435 run osmo-msc_10.42.42.6(pid=23119): Launched 07:33:58.576527 run osmo-stp_10.42.42.5(pid=23116): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23116)] 07:33:58.706535 run osmo-stp_10.42.42.5(pid=23116): stdout: | (launched: 2022-12-14_07:33:57.367078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:58.835783 run osmo-stp_10.42.42.5(pid=23116): stderr: | 20221214073357536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073357537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073357537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073357537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073357538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073357538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073357538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:58.963200 run osmo-stp_10.42.42.5(pid=23116): stdout: | (launched: 2022-12-14_07:33:57.367078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:59.084726 run osmo-stp_10.42.42.5(pid=23116): stderr: | 20221214073357536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073357537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073357537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073357537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073357538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073357538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073357538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:59.231073 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23116): Process ended prematurely: osmo-stp_10.42.42.5(pid=23116) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23116)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:33:59.239810 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:33:59.266357 run osmo-hlr_10.42.42.2(pid=23113): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23113)] 07:33:59.313999 run osmo-hlr_10.42.42.2(pid=23113): stdout: | (launched: 2022-12-14_07:33:56.408390) 07:33:59.363433 run osmo-hlr_10.42.42.2(pid=23113): stderr: | 20221214073356579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073356579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073356579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073356580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073356580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073356580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073356592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073356600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073356600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073356600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:59.432250 run osmo-msc_10.42.42.6(pid=23119): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23119)] 07:33:59.479697 run osmo-msc_10.42.42.6(pid=23119): stdout: | (launched: 2022-12-14_07:33:58.347881) 07:33:59.529215 run osmo-msc_10.42.42.6(pid=23119): stderr: | 20221214073358618 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073358618 DLGLOBAL DEBUG validating counter group 0x7f9c2e2c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073358618 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073358618 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073358618 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073358619 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073358620 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073358621 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073358621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073358621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:59.578747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23112): Terminating (SIGTERM) 07:33:59.618388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23115): Terminating (SIGTERM) 07:33:59.657995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23118): Terminating (SIGTERM) 07:33:59.697848 --- ParallelTerminationStrategy: PID 23112 died... 07:33:59.716826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23112): Terminated: ok {rc=0} 07:33:59.761088 --- ParallelTerminationStrategy: PID 23115 died... 07:33:59.779962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23115): Terminated: ok {rc=0} 07:33:59.823741 --- ParallelTerminationStrategy: PID 23118 died... 07:33:59.842446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23118): Terminated: ok {rc=0} 07:33:59.927346 bus /sierra_3: Setting Powered False 07:34:01.022428 bus /sierra_3: Setting Powered False 07:34:02.135870 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:34:03.286929 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:34:03.299432 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:34:03.372458 tst mo_mt_call_osmux.py: using LAC 39380 07:34:03.503213 tst mo_mt_call_osmux.py: using RAC 110 07:34:03.633206 tst mo_mt_call_osmux.py: using CellId 39380 07:34:03.761802 tst mo_mt_call_osmux.py: using BVCI 39381 07:34:03.875856 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:34:03.887715 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:34:03.899018 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:34:03.910248 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:34:03.921564 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:34:03.932463 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:34:04.053723 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:34:04.177538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:04.654779 run create_hlr_db(pid=23121): Launched 07:34:04.782305 bus /sierra_2: Setting Powered False 07:34:05.843109 run create_hlr_db(pid=23121): Terminated: ok {rc=0} 07:34:06.292601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23123): Launched 07:34:06.623120 run osmo-hlr_10.42.42.2(pid=23124): Launched 07:34:06.751382 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:07.320398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23126): Launched 07:34:07.649991 run osmo-stp_10.42.42.5(pid=23127): Launched 07:34:07.775307 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:08.366718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23129): Launched 07:34:08.698613 run osmo-msc_10.42.42.6(pid=23130): Launched 07:34:08.883199 run osmo-stp_10.42.42.5(pid=23127): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23127)] 07:34:09.021709 run osmo-stp_10.42.42.5(pid=23127): stdout: | (launched: 2022-12-14_07:34:07.590105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:09.160591 run osmo-stp_10.42.42.5(pid=23127): stderr: | 20221214073407780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073407780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073407780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073407780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073407781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073407781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073407781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:09.298175 run osmo-stp_10.42.42.5(pid=23127): stdout: | (launched: 2022-12-14_07:34:07.590105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:09.429051 run osmo-stp_10.42.42.5(pid=23127): stderr: | 20221214073407780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073407780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073407780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073407780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073407781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073407781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073407781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:09.585835 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23127): Process ended prematurely: osmo-stp_10.42.42.5(pid=23127) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23127)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:34:09.595322 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:34:09.623086 run osmo-hlr_10.42.42.2(pid=23124): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23124)] 07:34:09.675432 run osmo-hlr_10.42.42.2(pid=23124): stdout: | (launched: 2022-12-14_07:34:06.563325) 07:34:09.727708 run osmo-hlr_10.42.42.2(pid=23124): stderr: | 20221214073406758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073406758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073406758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073406758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073406758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073406758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073406770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073406781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073406781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073406781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:09.800241 run osmo-msc_10.42.42.6(pid=23130): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23130)] 07:34:09.850062 run osmo-msc_10.42.42.6(pid=23130): stdout: | (launched: 2022-12-14_07:34:08.638376) 07:34:09.902294 run osmo-msc_10.42.42.6(pid=23130): stderr: | 20221214073408957 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073408957 DLGLOBAL DEBUG validating counter group 0x7fbf4b968c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073408958 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073408958 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073408958 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073408958 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073408960 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073408960 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073408960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073408960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:09.954802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23123): Terminating (SIGTERM) 07:34:09.996432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23126): Terminating (SIGTERM) 07:34:10.038663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23129): Terminating (SIGTERM) 07:34:10.081227 --- ParallelTerminationStrategy: PID 23123 died... 07:34:10.101960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23123): Terminated: ok {rc=0} 07:34:10.148508 --- ParallelTerminationStrategy: PID 23126 died... 07:34:10.168730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23126): Terminated: ok {rc=0} 07:34:10.215157 --- ParallelTerminationStrategy: PID 23129 died... 07:34:10.235204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23129): Terminated: ok {rc=0} 07:34:10.324852 bus /sierra_3: Setting Powered False 07:34:11.423243 bus /sierra_3: Setting Powered False 07:34:12.541041 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:34:13.791655 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:34:13.798676 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:34:13.831990 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:34:13.859972 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:34:13.913583 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:34:13.946524 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:34:13.974009 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:34:14.520935 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:34:14.570434 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:14.581743 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:34:14.650164 tst mo_mt_call.py: using LAC 39381 07:34:14.771636 tst mo_mt_call.py: using RAC 111 07:34:14.894364 tst mo_mt_call.py: using CellId 39381 07:34:15.015910 tst mo_mt_call.py: using BVCI 39382 07:34:15.127611 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:15.138682 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:15.149599 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:15.160396 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:15.171283 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:15.182057 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:34:15.302828 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:34:15.420887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:15.927781 run create_hlr_db(pid=23137): Launched 07:34:16.094166 bus /sierra_2: Setting Powered False 07:34:17.154798 run create_hlr_db(pid=23137): Terminated: ok {rc=0} 07:34:17.621210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23139): Launched 07:34:17.950824 run osmo-hlr_10.42.42.2(pid=23140): Launched 07:34:18.078105 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:18.645263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23142): Launched 07:34:18.975488 run osmo-stp_10.42.42.5(pid=23143): Launched 07:34:19.102945 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:19.697217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23145): Launched 07:34:20.026903 run osmo-msc_10.42.42.6(pid=23146): Launched 07:34:20.212834 run osmo-stp_10.42.42.5(pid=23143): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23143)] 07:34:20.351444 run osmo-stp_10.42.42.5(pid=23143): stdout: | (launched: 2022-12-14_07:34:18.915566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:20.491319 run osmo-stp_10.42.42.5(pid=23143): stderr: | 20221214073419104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073419105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073419105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073419105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073419106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073419106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073419106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:20.629670 run osmo-stp_10.42.42.5(pid=23143): stdout: | (launched: 2022-12-14_07:34:18.915566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:20.760691 run osmo-stp_10.42.42.5(pid=23143): stderr: | 20221214073419104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073419105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073419105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073419105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073419106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073419106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073419106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:20.917348 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23143): Process ended prematurely: osmo-stp_10.42.42.5(pid=23143) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23143)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:34:20.927146 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:34:20.955013 run osmo-hlr_10.42.42.2(pid=23140): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23140)] 07:34:21.006497 run osmo-hlr_10.42.42.2(pid=23140): stdout: | (launched: 2022-12-14_07:34:17.891148) 07:34:21.058853 run osmo-hlr_10.42.42.2(pid=23140): stderr: | 20221214073418086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073418086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073418086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073418086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073418086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073418086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073418098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073418108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073418108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073418108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:21.131662 run osmo-msc_10.42.42.6(pid=23146): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23146)] 07:34:21.181508 run osmo-msc_10.42.42.6(pid=23146): stdout: | (launched: 2022-12-14_07:34:19.966816) 07:34:21.233892 run osmo-msc_10.42.42.6(pid=23146): stderr: | 20221214073420285 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073420285 DLGLOBAL DEBUG validating counter group 0x7f86d1796c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073420285 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073420285 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073420285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073420286 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073420287 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073420288 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073420288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073420288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:21.286331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23139): Terminating (SIGTERM) 07:34:21.328517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23142): Terminating (SIGTERM) 07:34:21.370859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23145): Terminating (SIGTERM) 07:34:21.413247 --- ParallelTerminationStrategy: PID 23139 died... 07:34:21.433866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23139): Terminated: ok {rc=0} 07:34:21.480490 --- ParallelTerminationStrategy: PID 23142 died... 07:34:21.500707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23142): Terminated: ok {rc=0} 07:34:21.547287 --- ParallelTerminationStrategy: PID 23145 died... 07:34:21.567559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23145): Terminated: ok {rc=0} 07:34:21.656639 bus /sierra_3: Setting Powered False 07:34:22.755961 bus /sierra_3: Setting Powered False 07:34:23.872880 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:34:25.017788 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:25.029629 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:34:25.098423 tst mo_mt_call_osmux.py: using LAC 39382 07:34:25.220304 tst mo_mt_call_osmux.py: using RAC 112 07:34:25.342800 tst mo_mt_call_osmux.py: using CellId 39382 07:34:25.462708 tst mo_mt_call_osmux.py: using BVCI 39383 07:34:25.583934 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:25.595761 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:25.607290 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:25.618870 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:25.631072 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:34:25.642952 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:34:25.759577 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:34:25.882648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:26.361245 run create_hlr_db(pid=23148): Launched 07:34:26.487408 bus /sierra_2: Setting Powered False 07:34:27.548270 run create_hlr_db(pid=23148): Terminated: ok {rc=0} 07:34:27.998023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23150): Launched 07:34:28.328769 run osmo-hlr_10.42.42.2(pid=23151): Launched 07:34:28.454291 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:29.023997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23153): Launched 07:34:29.354226 run osmo-stp_10.42.42.5(pid=23154): Launched 07:34:29.481402 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:30.076470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23156): Launched 07:34:30.407002 run osmo-msc_10.42.42.6(pid=23157): Launched 07:34:30.591506 run osmo-stp_10.42.42.5(pid=23154): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23154)] 07:34:30.730652 run osmo-stp_10.42.42.5(pid=23154): stdout: | (launched: 2022-12-14_07:34:29.294071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:30.926886 run osmo-stp_10.42.42.5(pid=23154): stderr: | 20221214073429482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073429482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073429483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073429483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073429484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073429484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073429484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:31.082611 run osmo-stp_10.42.42.5(pid=23154): stdout: | (launched: 2022-12-14_07:34:29.294071) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:31.208186 run osmo-stp_10.42.42.5(pid=23154): stderr: | 20221214073429482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073429482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073429483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073429483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073429484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073429484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073429484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:31.361428 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23154): Process ended prematurely: osmo-stp_10.42.42.5(pid=23154) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23154)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:34:31.371102 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:34:31.398587 run osmo-hlr_10.42.42.2(pid=23151): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23151)] 07:34:31.447612 run osmo-hlr_10.42.42.2(pid=23151): stdout: | (launched: 2022-12-14_07:34:28.268688) 07:34:31.499080 run osmo-hlr_10.42.42.2(pid=23151): stderr: | 20221214073428464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073428464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073428464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073428464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073428465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073428465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073428477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073428487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073428487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073428487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:31.570300 run osmo-msc_10.42.42.6(pid=23157): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23157)] 07:34:31.619182 run osmo-msc_10.42.42.6(pid=23157): stdout: | (launched: 2022-12-14_07:34:30.346641) 07:34:31.671404 run osmo-msc_10.42.42.6(pid=23157): stderr: | 20221214073430666 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073430666 DLGLOBAL DEBUG validating counter group 0x7f05c6617c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073430666 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073430666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073430666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073430667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073430668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073430669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073430669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073430669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:31.723300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23150): Terminating (SIGTERM) 07:34:31.764706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23153): Terminating (SIGTERM) 07:34:31.808349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23156): Terminating (SIGTERM) 07:34:31.852473 --- ParallelTerminationStrategy: PID 23150 died... 07:34:31.873171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23150): Terminated: ok {rc=0} 07:34:31.919866 --- ParallelTerminationStrategy: PID 23153 died... 07:34:31.940541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23153): Terminated: ok {rc=0} 07:34:31.985268 --- ParallelTerminationStrategy: PID 23156 died... 07:34:32.004330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23156): Terminated: ok {rc=0} 07:34:32.090054 bus /sierra_3: Setting Powered False 07:34:33.188602 bus /sierra_3: Setting Powered False 07:34:34.308218 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:34:35.553844 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:34:35.560308 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:34:35.592623 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:34:35.619458 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:34:35.670838 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:34:35.703474 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:34:35.730346 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:34:36.283468 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:34:36.337591 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:36.349394 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:34:36.419679 tst mo_mt_call.py: using LAC 39383 07:34:36.550487 tst mo_mt_call.py: using RAC 113 07:34:36.680256 tst mo_mt_call.py: using CellId 39383 07:34:36.810458 tst mo_mt_call.py: using BVCI 39384 07:34:36.931864 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:36.943417 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:36.954917 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:36.966846 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:36.978860 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:36.990964 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:34:37.110991 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:34:37.236705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:37.712602 run create_hlr_db(pid=23162): Launched 07:34:37.838932 bus /sierra_2: Setting Powered False 07:34:38.899601 run create_hlr_db(pid=23162): Terminated: ok {rc=0} 07:34:39.346990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23164): Launched 07:34:39.678639 run osmo-hlr_10.42.42.2(pid=23165): Launched 07:34:39.804455 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:40.377147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Launched 07:34:40.706757 run osmo-stp_10.42.42.5(pid=23168): Launched 07:34:40.833751 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:41.426708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23170): Launched 07:34:41.757947 run osmo-msc_10.42.42.6(pid=23171): Launched 07:34:41.943184 run osmo-stp_10.42.42.5(pid=23168): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23168)] 07:34:42.081356 run osmo-stp_10.42.42.5(pid=23168): stdout: | (launched: 2022-12-14_07:34:40.646995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:42.220062 run osmo-stp_10.42.42.5(pid=23168): stderr: | 20221214073440835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073440835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073440835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073440836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073440836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073440836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073440836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:42.354116 run osmo-stp_10.42.42.5(pid=23168): stdout: | (launched: 2022-12-14_07:34:40.646995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:42.477250 run osmo-stp_10.42.42.5(pid=23168): stderr: | 20221214073440835 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073440835 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073440835 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073440836 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073440836 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073440836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073440836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:42.624718 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23168): Process ended prematurely: osmo-stp_10.42.42.5(pid=23168) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23168)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:34:42.633792 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:34:42.660296 run osmo-hlr_10.42.42.2(pid=23165): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23165)] 07:34:42.709683 run osmo-hlr_10.42.42.2(pid=23165): stdout: | (launched: 2022-12-14_07:34:39.618906) 07:34:42.759977 run osmo-hlr_10.42.42.2(pid=23165): stderr: | 20221214073439811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073439811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073439812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073439812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073439812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073439812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073439824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073439833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073439833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073439833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:42.830433 run osmo-msc_10.42.42.6(pid=23171): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23171)] 07:34:42.878465 run osmo-msc_10.42.42.6(pid=23171): stdout: | (launched: 2022-12-14_07:34:41.697953) 07:34:42.928363 run osmo-msc_10.42.42.6(pid=23171): stderr: | 20221214073442017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073442017 DLGLOBAL DEBUG validating counter group 0x7eff5f42cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073442017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073442017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073442018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073442018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073442019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073442020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073442020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073442020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:42.978797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23164): Terminating (SIGTERM) 07:34:43.019037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Terminating (SIGTERM) 07:34:43.059260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23170): Terminating (SIGTERM) 07:34:43.099818 --- ParallelTerminationStrategy: PID 23164 died... 07:34:43.119528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23164): Terminated: ok {rc=0} 07:34:43.164139 --- ParallelTerminationStrategy: PID 23167 died... 07:34:43.183327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Terminated: ok {rc=0} 07:34:43.227869 --- ParallelTerminationStrategy: PID 23170 died... 07:34:43.247322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23170): Terminated: ok {rc=0} 07:34:43.334008 bus /sierra_3: Setting Powered False 07:34:44.432838 bus /sierra_3: Setting Powered False 07:34:45.547991 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:34:46.711477 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:46.724582 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:34:46.797954 tst mo_mt_call_osmux.py: using LAC 39384 07:34:46.975268 tst mo_mt_call_osmux.py: using RAC 114 07:34:47.132148 tst mo_mt_call_osmux.py: using CellId 39384 07:34:47.262365 tst mo_mt_call_osmux.py: using BVCI 39385 07:34:47.375764 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:47.387103 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:47.398129 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:47.409262 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:47.420938 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:34:47.432523 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:34:47.550852 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:34:47.674135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:48.183597 run create_hlr_db(pid=23173): Launched 07:34:48.309316 bus /sierra_2: Setting Powered False 07:34:49.374655 run create_hlr_db(pid=23173): Terminated: ok {rc=0} 07:34:49.813742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23175): Launched 07:34:50.123394 run osmo-hlr_10.42.42.2(pid=23176): Launched 07:34:50.240718 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:50.768736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23178): Launched 07:34:51.076422 run osmo-stp_10.42.42.5(pid=23179): Launched 07:34:51.193843 run osmo-msc_10.42.42.6: Starting osmo-msc 07:34:51.747838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23181): Launched 07:34:52.055584 run osmo-msc_10.42.42.6(pid=23182): Launched 07:34:52.226713 run osmo-stp_10.42.42.5(pid=23179): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23179)] 07:34:52.356626 run osmo-stp_10.42.42.5(pid=23179): stdout: | (launched: 2022-12-14_07:34:51.019701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:52.485966 run osmo-stp_10.42.42.5(pid=23179): stderr: | 20221214073451187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073451187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073451187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073451188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073451188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073451188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073451189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:52.613182 run osmo-stp_10.42.42.5(pid=23179): stdout: | (launched: 2022-12-14_07:34:51.019701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:52.734513 run osmo-stp_10.42.42.5(pid=23179): stderr: | 20221214073451187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073451187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073451187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073451188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073451188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073451188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073451189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:52.880120 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23179): Process ended prematurely: osmo-stp_10.42.42.5(pid=23179) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23179)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:34:52.889241 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:34:52.915986 run osmo-hlr_10.42.42.2(pid=23176): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23176)] 07:34:52.963448 run osmo-hlr_10.42.42.2(pid=23176): stdout: | (launched: 2022-12-14_07:34:50.066540) 07:34:53.012577 run osmo-hlr_10.42.42.2(pid=23176): stderr: | 20221214073450240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073450240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073450240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073450240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073450240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073450240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073450252 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073450262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073450262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073450262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:53.080910 run osmo-msc_10.42.42.6(pid=23182): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23182)] 07:34:53.128108 run osmo-msc_10.42.42.6(pid=23182): stdout: | (launched: 2022-12-14_07:34:51.999469) 07:34:53.177161 run osmo-msc_10.42.42.6(pid=23182): stderr: | 20221214073452266 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073452266 DLGLOBAL DEBUG validating counter group 0x7ff8c1ae2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073452266 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073452266 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073452266 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073452267 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073452269 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073452270 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073452270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073452270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:34:53.226233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23175): Terminating (SIGTERM) 07:34:53.265537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23178): Terminating (SIGTERM) 07:34:53.304793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23181): Terminating (SIGTERM) 07:34:53.344712 --- ParallelTerminationStrategy: PID 23175 died... 07:34:53.363899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23175): Terminated: ok {rc=0} 07:34:53.407605 --- ParallelTerminationStrategy: PID 23178 died... 07:34:53.426239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23178): Terminated: ok {rc=0} 07:34:53.469808 --- ParallelTerminationStrategy: PID 23181 died... 07:34:53.488882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23181): Terminated: ok {rc=0} 07:34:53.574868 bus /sierra_3: Setting Powered False 07:34:54.673633 bus /sierra_3: Setting Powered False 07:34:55.788047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:34:57.041561 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:34:57.048794 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:34:57.083149 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:34:57.110748 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:34:57.171373 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:34:57.204857 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:34:57.232560 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:34:57.782301 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:34:57.837903 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:34:57.849661 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:34:57.923965 tst mo_mt_call.py: using LAC 39385 07:34:58.053980 tst mo_mt_call.py: using RAC 115 07:34:58.183054 tst mo_mt_call.py: using CellId 39385 07:34:58.313923 tst mo_mt_call.py: using BVCI 39386 07:34:58.434494 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:34:58.446224 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:34:58.457846 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:34:58.469478 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:34:58.481474 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:34:58.493340 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:34:58.613642 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:34:58.735266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:59.246165 run create_hlr_db(pid=23187): Launched 07:34:59.373379 bus /sierra_2: Setting Powered False 07:35:00.438833 run create_hlr_db(pid=23187): Terminated: ok {rc=0} 07:35:00.932193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23189): Launched 07:35:01.290107 run osmo-hlr_10.42.42.2(pid=23190): Launched 07:35:01.510290 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:02.169527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23195): Launched 07:35:02.513664 run osmo-stp_10.42.42.5(pid=23196): Launched 07:35:02.642958 run osmo-msc_10.42.42.6: Starting osmo-msc 07:35:03.241601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23198): Launched 07:35:03.573943 run osmo-msc_10.42.42.6(pid=23199): Launched 07:35:03.760752 run osmo-stp_10.42.42.5(pid=23196): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23196)] 07:35:03.899606 run osmo-stp_10.42.42.5(pid=23196): stdout: | (launched: 2022-12-14_07:35:02.453551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:04.039413 run osmo-stp_10.42.42.5(pid=23196): stderr: | 20221214073502642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073502642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073502642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073502643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073502643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073502643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073502643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:04.176936 run osmo-stp_10.42.42.5(pid=23196): stdout: | (launched: 2022-12-14_07:35:02.453551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:04.307515 run osmo-stp_10.42.42.5(pid=23196): stderr: | 20221214073502642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073502642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073502642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073502643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073502643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073502643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073502643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:04.464447 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23196): Process ended prematurely: osmo-stp_10.42.42.5(pid=23196) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23196)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:35:04.474207 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 07:35:04.501943 run osmo-hlr_10.42.42.2(pid=23190): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23190)] 07:35:04.553727 run osmo-hlr_10.42.42.2(pid=23190): stdout: | (launched: 2022-12-14_07:35:01.229657) 07:35:04.606389 run osmo-hlr_10.42.42.2(pid=23190): stderr: | 20221214073501443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073501443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073501443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073501443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073501443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073501443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073501465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073501482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073501483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073501483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:04.679165 run osmo-msc_10.42.42.6(pid=23199): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23199)] 07:35:04.729746 run osmo-msc_10.42.42.6(pid=23199): stdout: | (launched: 2022-12-14_07:35:03.513375) 07:35:04.782048 run osmo-msc_10.42.42.6(pid=23199): stderr: | 20221214073503832 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073503833 DLGLOBAL DEBUG validating counter group 0x7f0599d39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073503833 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073503833 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073503833 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073503833 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073503835 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073503835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073503835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073503835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:35:04.834448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23189): Terminating (SIGTERM) 07:35:04.876490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23195): Terminating (SIGTERM) 07:35:04.918727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23198): Terminating (SIGTERM) 07:35:04.961115 --- ParallelTerminationStrategy: PID 23189 died... 07:35:04.981515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23189): Terminated: ok {rc=0} 07:35:05.028001 --- ParallelTerminationStrategy: PID 23195 died... 07:35:05.048001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23195): Terminated: ok {rc=0} 07:35:05.094268 --- ParallelTerminationStrategy: PID 23198 died... 07:35:05.114105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23198): Terminated: ok {rc=0} 07:35:05.202448 bus /sierra_3: Setting Powered False 07:35:06.302241 bus /sierra_3: Setting Powered False 07:35:07.419791 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:35:08.572920 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:35:08.585549 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:35:08.656897 tst mo_mt_call_osmux.py: using LAC 39386 07:35:08.785734 tst mo_mt_call_osmux.py: using RAC 116 07:35:08.905733 tst mo_mt_call_osmux.py: using CellId 39386 07:35:09.029703 tst mo_mt_call_osmux.py: using BVCI 39387 07:35:09.141904 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:35:09.153185 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:35:09.164212 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:35:09.175373 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:35:09.186598 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:35:09.197534 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:35:09.314878 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:35:09.437151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:09.949547 run create_hlr_db(pid=23201): Launched 07:35:10.077268 bus /sierra_2: Setting Powered False 07:35:11.142261 run create_hlr_db(pid=23201): Terminated: ok {rc=0} 07:35:11.582422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23203): Launched 07:35:11.893542 run osmo-hlr_10.42.42.2(pid=23204): Launched 07:35:12.012330 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:12.546097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23206): Launched 07:35:12.853993 run osmo-stp_10.42.42.5(pid=23207): Launched 07:35:12.970135 run osmo-msc_10.42.42.6: Starting osmo-msc 07:35:13.525231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23209): Launched 07:35:13.833631 run osmo-msc_10.42.42.6(pid=23210): Launched 07:35:14.006463 run osmo-stp_10.42.42.5(pid=23207): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23207)] 07:35:14.136216 run osmo-stp_10.42.42.5(pid=23207): stdout: | (launched: 2022-12-14_07:35:12.797460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:14.265932 run osmo-stp_10.42.42.5(pid=23207): stderr: | 20221214073512967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073512967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073512967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073512968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073512968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073512968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073512968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:14.393874 run osmo-stp_10.42.42.5(pid=23207): stdout: | (launched: 2022-12-14_07:35:12.797460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:14.516199 run osmo-stp_10.42.42.5(pid=23207): stderr: | 20221214073512967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073512967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073512967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073512968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073512968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073512968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073512968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:14.662765 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23207): Process ended prematurely: osmo-stp_10.42.42.5(pid=23207) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23207)] [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:35:14.671789 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:35:14.698395 run osmo-hlr_10.42.42.2(pid=23204): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23204)] 07:35:14.746503 run osmo-hlr_10.42.42.2(pid=23204): stdout: | (launched: 2022-12-14_07:35:11.837123) 07:35:14.796519 run osmo-hlr_10.42.42.2(pid=23204): stderr: | 20221214073512008 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073512008 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073512008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073512008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073512008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073512008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073512025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073512035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073512035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073512035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:14.866164 run osmo-msc_10.42.42.6(pid=23210): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23210)] 07:35:14.913967 run osmo-msc_10.42.42.6(pid=23210): stdout: | (launched: 2022-12-14_07:35:13.776522) 07:35:14.963580 run osmo-msc_10.42.42.6(pid=23210): stderr: | 20221214073514048 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073514048 DLGLOBAL DEBUG validating counter group 0x7f803a943c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073514048 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073514048 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073514048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073514048 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073514050 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073514050 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073514051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073514051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:35:15.014038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23203): Terminating (SIGTERM) 07:35:15.054333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23206): Terminating (SIGTERM) 07:35:15.094352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23209): Terminating (SIGTERM) 07:35:15.134664 --- ParallelTerminationStrategy: PID 23203 died... 07:35:15.154205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23203): Terminated: ok {rc=0} 07:35:15.198563 --- ParallelTerminationStrategy: PID 23206 died... 07:35:15.217487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23206): Terminated: ok {rc=0} 07:35:15.261504 --- ParallelTerminationStrategy: PID 23209 died... 07:35:15.280386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23209): Terminated: ok {rc=0} 07:35:15.364256 bus /sierra_3: Setting Powered False 07:35:16.459816 bus /sierra_3: Setting Powered False 07:35:17.576671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:35:18.833506 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:35:18.840218 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:35:18.872291 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:35:18.899907 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:35:18.952943 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:35:18.986273 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:35:19.013677 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:35:19.565542 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:35:19.619329 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:19.631054 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:35:19.702417 tst mo_mt_call.py: using LAC 39387 07:35:19.830713 tst mo_mt_call.py: using RAC 117 07:35:19.961223 tst mo_mt_call.py: using CellId 39387 07:35:20.090313 tst mo_mt_call.py: using BVCI 39388 07:35:20.211519 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:20.223110 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:20.234631 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:20.246187 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:20.258067 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:20.269779 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:35:20.387822 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:35:20.504086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:20.980713 run create_hlr_db(pid=23215): Launched 07:35:21.106882 bus /sierra_2: Setting Powered False 07:35:22.167752 run create_hlr_db(pid=23215): Terminated: ok {rc=0} 07:35:22.617967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23217): Launched 07:35:22.947912 run osmo-hlr_10.42.42.2(pid=23218): Launched 07:35:23.073528 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:23.643750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23220): Launched 07:35:23.973411 run osmo-stp_10.42.42.5(pid=23221): Launched 07:35:24.101686 run osmo-msc_10.42.42.6: Starting osmo-msc 07:35:24.702620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23223): Launched 07:35:25.033659 run osmo-msc_10.42.42.6(pid=23224): Launched 07:35:25.219279 run osmo-stp_10.42.42.5(pid=23221): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23221)] 07:35:25.359484 run osmo-stp_10.42.42.5(pid=23221): stdout: | (launched: 2022-12-14_07:35:23.913546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:25.499660 run osmo-stp_10.42.42.5(pid=23221): stderr: | 20221214073524103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073524103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073524103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073524104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073524104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073524104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073524105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:25.638329 run osmo-stp_10.42.42.5(pid=23221): stdout: | (launched: 2022-12-14_07:35:23.913546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:25.769592 run osmo-stp_10.42.42.5(pid=23221): stderr: | 20221214073524103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073524103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073524103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073524104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073524104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073524104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073524105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:25.927344 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23221): Process ended prematurely: osmo-stp_10.42.42.5(pid=23221) [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23221)] [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:35:25.936896 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:35:25.964765 run osmo-hlr_10.42.42.2(pid=23218): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23218)] 07:35:26.015655 run osmo-hlr_10.42.42.2(pid=23218): stdout: | (launched: 2022-12-14_07:35:22.887713) 07:35:26.067393 run osmo-hlr_10.42.42.2(pid=23218): stderr: | 20221214073523082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073523082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073523082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073523083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073523083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073523083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073523095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073523104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073523104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073523104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:26.139628 run osmo-msc_10.42.42.6(pid=23224): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23224)] 07:35:26.189443 run osmo-msc_10.42.42.6(pid=23224): stdout: | (launched: 2022-12-14_07:35:24.973409) 07:35:26.241465 run osmo-msc_10.42.42.6(pid=23224): stderr: | 20221214073525292 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073525292 DLGLOBAL DEBUG validating counter group 0x7ff699bd1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073525292 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073525292 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073525293 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073525293 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073525294 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073525295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073525295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073525295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:35:26.293718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23217): Terminating (SIGTERM) 07:35:26.335267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23220): Terminating (SIGTERM) 07:35:26.377073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23223): Terminating (SIGTERM) 07:35:26.419011 --- ParallelTerminationStrategy: PID 23217 died... 07:35:26.439210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23217): Terminated: ok {rc=0} 07:35:26.485580 --- ParallelTerminationStrategy: PID 23220 died... 07:35:26.505664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23220): Terminated: ok {rc=0} 07:35:26.552276 --- ParallelTerminationStrategy: PID 23223 died... 07:35:26.572235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23223): Terminated: ok {rc=0} 07:35:26.660404 bus /sierra_3: Setting Powered False 07:35:27.758932 bus /sierra_3: Setting Powered False 07:35:28.875171 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:35:30.025619 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:30.038322 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:35:30.111284 tst mo_mt_call_osmux.py: using LAC 39388 07:35:30.242705 tst mo_mt_call_osmux.py: using RAC 118 07:35:30.372218 tst mo_mt_call_osmux.py: using CellId 39388 07:35:30.501444 tst mo_mt_call_osmux.py: using BVCI 39389 07:35:30.623308 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:30.635205 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:30.646788 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:30.658553 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:30.670631 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:35:30.682611 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:35:30.801672 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:35:30.937983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:31.437803 run create_hlr_db(pid=23226): Launched 07:35:31.601465 bus /sierra_2: Setting Powered False 07:35:32.662985 run create_hlr_db(pid=23226): Terminated: ok {rc=0} 07:35:33.119821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23228): Launched 07:35:33.450151 run osmo-hlr_10.42.42.2(pid=23229): Launched 07:35:33.577886 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:34.147436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23231): Launched 07:35:34.479325 run osmo-stp_10.42.42.5(pid=23232): Launched 07:35:34.605343 run osmo-msc_10.42.42.6: Starting osmo-msc 07:35:35.201201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23234): Launched 07:35:35.533305 run osmo-msc_10.42.42.6(pid=23235): Launched 07:35:35.717687 run osmo-stp_10.42.42.5(pid=23232): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23232)] 07:35:35.856509 run osmo-stp_10.42.42.5(pid=23232): stdout: | (launched: 2022-12-14_07:35:34.418614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:35.996613 run osmo-stp_10.42.42.5(pid=23232): stderr: | 20221214073534608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073534608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073534609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073534609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073534609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073534609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073534610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:36.133974 run osmo-stp_10.42.42.5(pid=23232): stdout: | (launched: 2022-12-14_07:35:34.418614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:36.264814 run osmo-stp_10.42.42.5(pid=23232): stderr: | 20221214073534608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073534608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073534609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073534609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073534609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073534609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073534610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:36.421606 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23232): Process ended prematurely: osmo-stp_10.42.42.5(pid=23232) [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23232)] [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:35:36.431252 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:35:36.459085 run osmo-hlr_10.42.42.2(pid=23229): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23229)] 07:35:36.510018 run osmo-hlr_10.42.42.2(pid=23229): stdout: | (launched: 2022-12-14_07:35:33.390179) 07:35:36.562492 run osmo-hlr_10.42.42.2(pid=23229): stderr: | 20221214073533585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073533585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073533585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073533585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073533585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073533586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073533597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073533606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073533606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073533606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:36.635498 run osmo-msc_10.42.42.6(pid=23235): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23235)] 07:35:36.685629 run osmo-msc_10.42.42.6(pid=23235): stdout: | (launched: 2022-12-14_07:35:35.472938) 07:35:36.737969 run osmo-msc_10.42.42.6(pid=23235): stderr: | 20221214073535791 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073535791 DLGLOBAL DEBUG validating counter group 0x7f9a95ce6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073535791 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073535791 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073535792 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073535792 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073535794 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073535794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073535794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073535794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:35:36.790151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23228): Terminating (SIGTERM) 07:35:36.831939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23231): Terminating (SIGTERM) 07:35:36.874180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23234): Terminating (SIGTERM) 07:35:36.916626 --- ParallelTerminationStrategy: PID 23228 died... 07:35:36.937068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23228): Terminated: ok {rc=0} 07:35:36.983566 --- ParallelTerminationStrategy: PID 23231 died... 07:35:37.003464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23231): Terminated: ok {rc=0} 07:35:37.049809 --- ParallelTerminationStrategy: PID 23234 died... 07:35:37.069638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23234): Terminated: ok {rc=0} 07:35:37.158616 bus /sierra_3: Setting Powered False 07:35:38.257769 bus /sierra_3: Setting Powered False 07:35:39.373730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:35:40.628579 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:35:40.634887 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:35:40.668382 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:35:40.697027 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:35:40.751999 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:35:40.785200 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:35:40.812588 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:35:41.361799 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:35:41.415105 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:41.426493 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:35:41.498274 tst mo_mt_call.py: using LAC 39389 07:35:41.631495 tst mo_mt_call.py: using RAC 119 07:35:41.761301 tst mo_mt_call.py: using CellId 39389 07:35:41.895774 tst mo_mt_call.py: using BVCI 39390 07:35:42.018769 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:42.029880 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:42.040724 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:42.051770 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:42.062587 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:42.074539 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:35:42.195435 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:35:42.313068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:42.790729 run create_hlr_db(pid=23242): Launched 07:35:42.919346 bus /sierra_2: Setting Powered False 07:35:43.983950 run create_hlr_db(pid=23242): Terminated: ok {rc=0} 07:35:44.443359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23244): Launched 07:35:44.777717 run osmo-hlr_10.42.42.2(pid=23245): Launched 07:35:44.906299 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:45.476074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23247): Launched 07:35:45.806570 run osmo-stp_10.42.42.5(pid=23248): Launched 07:35:46.128174 run osmo-msc_10.42.42.6: Starting osmo-msc 07:35:46.749746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23250): Launched 07:35:47.096491 run osmo-msc_10.42.42.6(pid=23251): Launched 07:35:47.389688 run osmo-stp_10.42.42.5(pid=23248): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23248)] 07:35:47.530203 run osmo-stp_10.42.42.5(pid=23248): stdout: | (launched: 2022-12-14_07:35:45.746397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:47.668209 run osmo-stp_10.42.42.5(pid=23248): stderr: | 20221214073545969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073545969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073545969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073545970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073545970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073545970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073545970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:47.806705 run osmo-stp_10.42.42.5(pid=23248): stdout: | (launched: 2022-12-14_07:35:45.746397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:47.937771 run osmo-stp_10.42.42.5(pid=23248): stderr: | 20221214073545969 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073545969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073545969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073545970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073545970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073545970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073545970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:48.095243 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23248): Process ended prematurely: osmo-stp_10.42.42.5(pid=23248) [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23248)] [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:35:48.104829 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 07:35:48.132991 run osmo-hlr_10.42.42.2(pid=23245): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23245)] 07:35:48.184410 run osmo-hlr_10.42.42.2(pid=23245): stdout: | (launched: 2022-12-14_07:35:44.717452) 07:35:48.236880 run osmo-hlr_10.42.42.2(pid=23245): stderr: | 20221214073544911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073544911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073544911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073544911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073544911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073544912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073544924 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073544934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073544934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073544934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:48.310127 run osmo-msc_10.42.42.6(pid=23251): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23251)] 07:35:48.360856 run osmo-msc_10.42.42.6(pid=23251): stdout: | (launched: 2022-12-14_07:35:47.034400) 07:35:48.413660 run osmo-msc_10.42.42.6(pid=23251): stderr: | 20221214073547479 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073547479 DLGLOBAL DEBUG validating counter group 0x7fd886447c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073547479 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073547479 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073547482 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073547482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073547483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073547484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073547484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073547484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:35:48.466620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23244): Terminating (SIGTERM) 07:35:48.508558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23247): Terminating (SIGTERM) 07:35:48.551183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23250): Terminating (SIGTERM) 07:35:48.593906 --- ParallelTerminationStrategy: PID 23244 died... 07:35:48.614333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23244): Terminated: ok {rc=0} 07:35:48.660610 --- ParallelTerminationStrategy: PID 23247 died... 07:35:48.680403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23247): Terminated: ok {rc=0} 07:35:48.726880 --- ParallelTerminationStrategy: PID 23250 died... 07:35:48.746879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23250): Terminated: ok {rc=0} 07:35:48.835394 bus /sierra_3: Setting Powered False 07:35:49.932404 bus /sierra_3: Setting Powered False 07:35:51.049304 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:35:52.200694 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:52.213184 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:35:52.286509 tst mo_mt_call_osmux.py: using LAC 39390 07:35:52.408862 tst mo_mt_call_osmux.py: using RAC 120 07:35:52.529421 tst mo_mt_call_osmux.py: using CellId 39390 07:35:52.660240 tst mo_mt_call_osmux.py: using BVCI 39391 07:35:52.782470 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:52.794216 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:52.805653 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:52.816874 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:52.828733 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:35:52.840880 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:35:52.959397 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:35:53.080451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:53.592239 run create_hlr_db(pid=23253): Launched 07:35:53.718677 bus /sierra_2: Setting Powered False 07:35:54.783232 run create_hlr_db(pid=23253): Terminated: ok {rc=0} 07:35:55.222717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23255): Launched 07:35:55.532593 run osmo-hlr_10.42.42.2(pid=23256): Launched 07:35:55.650547 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:56.193748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23258): Launched 07:35:56.502291 run osmo-stp_10.42.42.5(pid=23259): Launched 07:35:56.622746 run osmo-msc_10.42.42.6: Starting osmo-msc 07:35:57.184306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23261): Launched 07:35:57.494142 run osmo-msc_10.42.42.6(pid=23262): Launched 07:35:57.669989 run osmo-stp_10.42.42.5(pid=23259): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23259)] 07:35:57.801610 run osmo-stp_10.42.42.5(pid=23259): stdout: | (launched: 2022-12-14_07:35:56.445595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:57.931611 run osmo-stp_10.42.42.5(pid=23259): stderr: | 20221214073556613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073556613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073556613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073556614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073556614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073556614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073556614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:58.059467 run osmo-stp_10.42.42.5(pid=23259): stdout: | (launched: 2022-12-14_07:35:56.445595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:58.181737 run osmo-stp_10.42.42.5(pid=23259): stderr: | 20221214073556613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073556613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073556613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073556614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073556614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073556614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073556614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:58.328189 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23259): Process ended prematurely: osmo-stp_10.42.42.5(pid=23259) [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23259)] [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:35:58.337344 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:35:58.364169 run osmo-hlr_10.42.42.2(pid=23256): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23256)] 07:35:58.412146 run osmo-hlr_10.42.42.2(pid=23256): stdout: | (launched: 2022-12-14_07:35:55.475952) 07:35:58.461989 run osmo-hlr_10.42.42.2(pid=23256): stderr: | 20221214073555649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073555649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073555649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073555649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073555649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073555649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073555662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073555670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073555670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073555670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:58.531348 run osmo-msc_10.42.42.6(pid=23262): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23262)] 07:35:58.579467 run osmo-msc_10.42.42.6(pid=23262): stdout: | (launched: 2022-12-14_07:35:57.437279) 07:35:58.629127 run osmo-msc_10.42.42.6(pid=23262): stderr: | 20221214073557705 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073557705 DLGLOBAL DEBUG validating counter group 0x7f59fc332c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073557705 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073557705 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073557705 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073557706 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073557707 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073557708 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073557708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073557708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:35:58.679125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23255): Terminating (SIGTERM) 07:35:58.719354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23258): Terminating (SIGTERM) 07:35:58.759945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23261): Terminating (SIGTERM) 07:35:58.801075 --- ParallelTerminationStrategy: PID 23255 died... 07:35:58.820757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23255): Terminated: ok {rc=0} 07:35:58.865256 --- ParallelTerminationStrategy: PID 23258 died... 07:35:58.883963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23258): Terminated: ok {rc=0} 07:35:58.928099 --- ParallelTerminationStrategy: PID 23261 died... 07:35:58.946972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23261): Terminated: ok {rc=0} 07:35:59.031625 bus /sierra_3: Setting Powered False 07:36:00.129477 bus /sierra_3: Setting Powered False 07:36:01.262620 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:36:02.517564 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:36:02.523765 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:36:02.555841 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 07:36:02.582976 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 07:36:02.635486 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:36:02.669495 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 07:36:02.696004 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 07:36:03.248190 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 07:36:03.302798 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:03.315001 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:36:03.368668 tst mo_mt_call.py: using LAC 39391 07:36:03.499570 tst mo_mt_call.py: using RAC 121 07:36:03.629388 tst mo_mt_call.py: using CellId 39391 07:36:03.759103 tst mo_mt_call.py: using BVCI 39392 07:36:03.881065 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:03.893444 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:03.905288 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:03.916914 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:03.929278 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:03.941495 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:36:04.059340 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:36:04.182041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:04.696830 run create_hlr_db(pid=23267): Launched 07:36:04.822320 bus /sierra_2: Setting Powered False 07:36:05.887057 run create_hlr_db(pid=23267): Terminated: ok {rc=0} 07:36:06.345697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23269): Launched 07:36:06.678792 run osmo-hlr_10.42.42.2(pid=23270): Launched 07:36:06.806646 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:07.377656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23272): Launched 07:36:07.711509 run osmo-stp_10.42.42.5(pid=23273): Launched 07:36:07.839672 run osmo-msc_10.42.42.6: Starting osmo-msc 07:36:08.437409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23275): Launched 07:36:08.771327 run osmo-msc_10.42.42.6(pid=23276): Launched 07:36:08.955346 run osmo-stp_10.42.42.5(pid=23273): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23273)] 07:36:09.094444 run osmo-stp_10.42.42.5(pid=23273): stdout: | (launched: 2022-12-14_07:36:07.650902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:09.234162 run osmo-stp_10.42.42.5(pid=23273): stderr: | 20221214073607839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073607839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073607839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073607840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073607840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073607840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073607840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:09.371855 run osmo-stp_10.42.42.5(pid=23273): stdout: | (launched: 2022-12-14_07:36:07.650902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:09.503131 run osmo-stp_10.42.42.5(pid=23273): stderr: | 20221214073607839 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073607839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073607839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073607840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073607840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073607840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073607840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:09.660632 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23273): Process ended prematurely: osmo-stp_10.42.42.5(pid=23273) [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23273)] [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 07:36:09.670326 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:36:09.698109 run osmo-hlr_10.42.42.2(pid=23270): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23270)] 07:36:09.749363 run osmo-hlr_10.42.42.2(pid=23270): stdout: | (launched: 2022-12-14_07:36:06.618490) 07:36:09.801646 run osmo-hlr_10.42.42.2(pid=23270): stderr: | 20221214073606814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073606814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073606814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073606814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073606814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073606814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073606826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073606836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073606837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073606837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:09.874551 run osmo-msc_10.42.42.6(pid=23276): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23276)] 07:36:09.924656 run osmo-msc_10.42.42.6(pid=23276): stdout: | (launched: 2022-12-14_07:36:08.710733) 07:36:09.977155 run osmo-msc_10.42.42.6(pid=23276): stderr: | 20221214073609030 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073609030 DLGLOBAL DEBUG validating counter group 0x7fc5a1ce6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073609030 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073609030 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073609031 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073609031 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073609032 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073609033 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073609033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073609033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:36:10.029703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23269): Terminating (SIGTERM) 07:36:10.071838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23272): Terminating (SIGTERM) 07:36:10.114473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23275): Terminating (SIGTERM) 07:36:10.157220 --- ParallelTerminationStrategy: PID 23269 died... 07:36:10.177762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23269): Terminated: ok {rc=0} 07:36:10.224594 --- ParallelTerminationStrategy: PID 23272 died... 07:36:10.244587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23272): Terminated: ok {rc=0} 07:36:10.291210 --- ParallelTerminationStrategy: PID 23275 died... 07:36:10.311126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23275): Terminated: ok {rc=0} 07:36:10.399317 bus /sierra_3: Setting Powered False 07:36:11.498822 bus /sierra_3: Setting Powered False 07:36:12.616373 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 07:36:13.763650 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:13.775897 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:36:13.828162 tst mo_mt_call_osmux.py: using LAC 39392 07:36:13.950091 tst mo_mt_call_osmux.py: using RAC 122 07:36:14.081050 tst mo_mt_call_osmux.py: using CellId 39392 07:36:14.210856 tst mo_mt_call_osmux.py: using BVCI 39393 07:36:14.331484 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:14.343544 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:14.355357 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:14.367180 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:14.379254 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:36:14.391062 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:36:14.509315 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:36:14.627942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:15.105666 run create_hlr_db(pid=23278): Launched 07:36:15.232824 bus /sierra_2: Setting Powered False 07:36:16.293630 run create_hlr_db(pid=23278): Terminated: ok {rc=0} 07:36:16.810944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23280): Launched 07:36:17.163375 run osmo-hlr_10.42.42.2(pid=23281): Launched 07:36:17.317229 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:17.849273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23283): Launched 07:36:18.159357 run osmo-stp_10.42.42.5(pid=23284): Launched 07:36:18.277195 run osmo-msc_10.42.42.6: Starting osmo-msc 07:36:18.833754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23286): Launched 07:36:19.146881 run osmo-msc_10.42.42.6(pid=23287): Launched 07:36:19.318675 run osmo-stp_10.42.42.5(pid=23284): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23284)] 07:36:19.448339 run osmo-stp_10.42.42.5(pid=23284): stdout: | (launched: 2022-12-14_07:36:18.102718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:19.578753 run osmo-stp_10.42.42.5(pid=23284): stderr: | 20221214073618270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073618270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073618270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073618271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073618271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073618271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073618271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:19.706400 run osmo-stp_10.42.42.5(pid=23284): stdout: | (launched: 2022-12-14_07:36:18.102718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:19.828465 run osmo-stp_10.42.42.5(pid=23284): stderr: | 20221214073618270 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073618270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073618270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073618271 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073618271 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073618271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073618271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:19.974676 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23284): Process ended prematurely: osmo-stp_10.42.42.5(pid=23284) [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23284)] [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 07:36:19.983842 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:36:20.010304 run osmo-hlr_10.42.42.2(pid=23281): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23281)] 07:36:20.057963 run osmo-hlr_10.42.42.2(pid=23281): stdout: | (launched: 2022-12-14_07:36:17.103373) 07:36:20.107437 run osmo-hlr_10.42.42.2(pid=23281): stderr: | 20221214073617310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073617310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073617310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073617310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073617310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073617310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073617324 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073617333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073617334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073617334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:20.175965 run osmo-msc_10.42.42.6(pid=23287): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23287)] 07:36:20.223415 run osmo-msc_10.42.42.6(pid=23287): stdout: | (launched: 2022-12-14_07:36:19.089792) 07:36:20.272434 run osmo-msc_10.42.42.6(pid=23287): stderr: | 20221214073619359 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073619359 DLGLOBAL DEBUG validating counter group 0x7f2efa934c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073619359 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073619359 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073619359 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073619359 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073619361 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073619361 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073619362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073619362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:36:20.321900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23280): Terminating (SIGTERM) 07:36:20.361366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23283): Terminating (SIGTERM) 07:36:20.400843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23286): Terminating (SIGTERM) 07:36:20.440573 --- ParallelTerminationStrategy: PID 23280 died... 07:36:20.459900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23280): Terminated: ok {rc=0} 07:36:20.503909 --- ParallelTerminationStrategy: PID 23283 died... 07:36:20.522636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23283): Terminated: ok {rc=0} 07:36:20.566699 --- ParallelTerminationStrategy: PID 23286 died... 07:36:20.585420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23286): Terminated: ok {rc=0} 07:36:20.671257 bus /sierra_3: Setting Powered False 07:36:21.770719 bus /sierra_3: Setting Powered False 07:36:22.887295 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 emergency:trx-umtrx --------------------------------------------------------------------- 07:36:24.140628 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:36:24.145681 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:36:24.178832 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 07:36:24.207254 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 07:36:24.294616 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:36:24.327524 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 07:36:24.355114 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 07:36:24.938678 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2401 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 07:36:24.944243 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:24.955624 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 07:36:25.005415 tst emergency_mo_mt_call.py: using LAC 39393 07:36:25.131998 tst emergency_mo_mt_call.py: using RAC 123 07:36:25.255269 tst emergency_mo_mt_call.py: using CellId 39393 07:36:25.373196 tst emergency_mo_mt_call.py: using BVCI 39394 07:36:25.483319 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:25.494232 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:25.504847 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:25.515600 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:25.526251 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:25.536758 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:36:25.659213 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:36:25.781463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:26.286488 run create_hlr_db(pid=23292): Launched 07:36:26.410631 bus /sierra_2: Setting Powered False 07:36:27.470869 run create_hlr_db(pid=23292): Terminated: ok {rc=0} 07:36:27.894458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23294): Launched 07:36:28.197727 run osmo-hlr_10.42.42.2(pid=23295): Launched 07:36:28.312187 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:28.835461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23297): Launched 07:36:29.138749 run osmo-stp_10.42.42.5(pid=23298): Launched 07:36:29.264656 tst emergency_mo_mt_call.py: using MSISDN 8568 07:36:29.429603 run osmo-msc_10.42.42.6: Starting osmo-msc 07:36:29.974296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23300): Launched 07:36:30.278141 run osmo-msc_10.42.42.6(pid=23301): Launched 07:36:30.449679 run osmo-stp_10.42.42.5(pid=23298): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23298)] 07:36:30.577372 run osmo-stp_10.42.42.5(pid=23298): stdout: | (launched: 2022-12-14_07:36:29.083053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:30.705369 run osmo-stp_10.42.42.5(pid=23298): stderr: | 20221214073629248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073629248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073629248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073629249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073629249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073629250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073629250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:30.833678 run osmo-stp_10.42.42.5(pid=23298): stdout: | (launched: 2022-12-14_07:36:29.083053) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:30.998041 run osmo-stp_10.42.42.5(pid=23298): stderr: | 20221214073629248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073629248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073629248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073629249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073629249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073629250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073629250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:31.160468 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23298): Process ended prematurely: osmo-stp_10.42.42.5(pid=23298) [trial-2401↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23298)] [trial-2401↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 07:36:31.170699 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 07:36:31.199274 run osmo-hlr_10.42.42.2(pid=23295): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23295)] 07:36:31.254077 run osmo-hlr_10.42.42.2(pid=23295): stdout: | (launched: 2022-12-14_07:36:28.142159) 07:36:31.309907 run osmo-hlr_10.42.42.2(pid=23295): stderr: | 20221214073628315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073628315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073628315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073628315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073628315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073628315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073628327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073628336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073628336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073628336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:31.385203 run osmo-msc_10.42.42.6(pid=23301): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23301)] 07:36:31.437635 run osmo-msc_10.42.42.6(pid=23301): stdout: | (launched: 2022-12-14_07:36:30.222218) 07:36:31.493423 run osmo-msc_10.42.42.6(pid=23301): stderr: | 20221214073630490 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073630490 DLGLOBAL DEBUG validating counter group 0x7f9884079c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073630490 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073630491 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073630491 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073630491 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073630493 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073630493 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073630493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073630493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:36:31.548787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23294): Terminating (SIGTERM) 07:36:31.593583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23297): Terminating (SIGTERM) 07:36:31.640021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23300): Terminating (SIGTERM) 07:36:31.690233 --- ParallelTerminationStrategy: PID 23294 died... 07:36:31.711080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23294): Terminated: ok {rc=0} 07:36:31.762522 --- ParallelTerminationStrategy: PID 23297 died... 07:36:31.783064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23297): Terminated: ok {rc=0} 07:36:31.832650 --- ParallelTerminationStrategy: PID 23300 died... 07:36:31.853296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23300): Terminated: ok {rc=0} 07:36:31.948353 bus /sierra_3: Setting Powered False 07:36:33.047804 bus /sierra_3: Setting Powered False 07:36:34.163220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 07:36:35.251747 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:35.263228 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 07:36:35.313071 tst emergency_preemptive_call.py: using LAC 39394 07:36:35.441438 tst emergency_preemptive_call.py: using RAC 124 07:36:35.560320 tst emergency_preemptive_call.py: using CellId 39394 07:36:35.680566 tst emergency_preemptive_call.py: using BVCI 39395 07:36:35.790261 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:35.800894 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:35.811444 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:35.822005 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:35.832354 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:36:35.843122 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:36:35.958381 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:36:36.080225 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:36:36.196833 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:36:36.314734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:36.821354 run create_hlr_db(pid=23304): Launched 07:36:36.946535 bus /sierra_2: Setting Powered False 07:36:38.010584 run create_hlr_db(pid=23304): Terminated: ok {rc=0} 07:36:38.446054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23306): Launched 07:36:38.750510 run osmo-hlr_10.42.42.2(pid=23307): Launched 07:36:38.865313 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:39.384847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23309): Launched 07:36:39.687878 run osmo-stp_10.42.42.5(pid=23310): Launched 07:36:39.811945 tst emergency_preemptive_call.py: using MSISDN 8569 07:36:39.966964 run osmo-msc_10.42.42.6: Starting osmo-msc 07:36:40.513920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23312): Launched 07:36:40.816343 run osmo-msc_10.42.42.6(pid=23313): Launched 07:36:40.985141 run osmo-stp_10.42.42.5(pid=23310): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23310)] 07:36:41.113377 run osmo-stp_10.42.42.5(pid=23310): stdout: | (launched: 2022-12-14_07:36:39.632150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:41.241715 run osmo-stp_10.42.42.5(pid=23310): stderr: | 20221214073639800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073639800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073639800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073639801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073639801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073639801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073639801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:41.366939 run osmo-stp_10.42.42.5(pid=23310): stdout: | (launched: 2022-12-14_07:36:39.632150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:41.486795 run osmo-stp_10.42.42.5(pid=23310): stderr: | 20221214073639800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073639800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073639800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073639801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073639801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073639801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073639801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:41.630688 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23310): Process ended prematurely: osmo-stp_10.42.42.5(pid=23310) [trial-2401↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23310)] [trial-2401↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 07:36:41.639092 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 07:36:41.665312 run osmo-hlr_10.42.42.2(pid=23307): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23307)] 07:36:41.712648 run osmo-hlr_10.42.42.2(pid=23307): stdout: | (launched: 2022-12-14_07:36:38.694115) 07:36:41.761431 run osmo-hlr_10.42.42.2(pid=23307): stderr: | 20221214073638865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073638865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073638865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073638865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073638865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073638865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073638877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073638886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073638886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073638887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:41.830185 run osmo-msc_10.42.42.6(pid=23313): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23313)] 07:36:41.877362 run osmo-msc_10.42.42.6(pid=23313): stdout: | (launched: 2022-12-14_07:36:40.760533) 07:36:41.926269 run osmo-msc_10.42.42.6(pid=23313): stderr: | 20221214073641030 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214073641031 DLGLOBAL DEBUG validating counter group 0x7ff83bcafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214073641031 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214073641031 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214073641031 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214073641031 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214073641033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214073641033 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214073641034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214073641034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:36:41.975463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23306): Terminating (SIGTERM) 07:36:42.014656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23309): Terminating (SIGTERM) 07:36:42.054168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23312): Terminating (SIGTERM) 07:36:42.093969 --- ParallelTerminationStrategy: PID 23306 died... 07:36:42.113275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23306): Terminated: ok {rc=0} 07:36:42.157278 --- ParallelTerminationStrategy: PID 23309 died... 07:36:42.175965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23309): Terminated: ok {rc=0} 07:36:42.219528 --- ParallelTerminationStrategy: PID 23312 died... 07:36:42.238136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23312): Terminated: ok {rc=0} 07:36:42.323534 bus /sierra_9: Setting Powered False 07:36:43.421602 bus /sierra_9: Setting Powered False 07:36:44.533703 bus /sierra_8: Setting Powered False 07:36:45.628670 bus /sierra_8: Setting Powered False 07:36:46.754154 bus /sierra_3: Setting Powered False 07:36:47.861593 bus /sierra_3: Setting Powered False 07:36:48.977156 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx --------------------------------------------------------------------- 07:36:50.261037 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:36:50.265734 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:36:50.298508 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 07:36:50.338305 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 07:36:50.425104 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:36:50.457808 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 07:36:50.497114 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 07:36:51.086105 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 07:36:51.137389 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:36:51.148045 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:36:51.194703 tst cs_paging_gprs_active.py: using LAC 39395 07:36:51.317528 tst cs_paging_gprs_active.py: using RAC 125 07:36:51.437541 tst cs_paging_gprs_active.py: using CellId 39395 07:36:51.567801 tst cs_paging_gprs_active.py: using BVCI 39396 07:36:51.691359 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:36:51.702559 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:36:51.713455 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:36:51.724355 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:36:51.735454 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:36:51.746616 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:36:51.758060 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:36:51.769097 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:36:51.780339 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:36:51.899582 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:36:52.016923 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:36:52.225666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:52.536134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23318): Launched 07:36:52.807036 run iperf3-srv_10.42.42.10(pid=23319): Launched 07:36:52.925534 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:36:53.133196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:53.444671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23320): Launched 07:36:53.714583 run iperf3-srv_10.42.42.10(pid=23321): Launched 07:36:53.833131 tst cs_paging_gprs_active.py:38: start network... 07:36:54.040491 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:54.519805 run create_hlr_db(pid=23322): Launched 07:36:54.647847 bus /sierra_2: Setting Powered False 07:36:55.708356 run create_hlr_db(pid=23322): Terminated: ok {rc=0} 07:36:56.161756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23324): Launched 07:36:56.497521 run osmo-hlr_10.42.42.2(pid=23325): Launched 07:36:56.627779 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:57.205256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23327): Launched 07:36:57.538683 run osmo-stp_10.42.42.5(pid=23328): Launched 07:36:57.667674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:58.237969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23330): Launched 07:36:58.364914 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:58.645793 run patchelf(pid=23331): Launched 07:36:58.832064 run osmo-stp_10.42.42.5(pid=23328): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23328)] 07:36:58.973578 run osmo-stp_10.42.42.5(pid=23328): stdout: | (launched: 2022-12-14_07:36:57.478113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:59.116349 run osmo-stp_10.42.42.5(pid=23328): stderr: | 20221214073657667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073657667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073657667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073657668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073657668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073657668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073657668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:59.258599 run osmo-stp_10.42.42.5(pid=23328): stdout: | (launched: 2022-12-14_07:36:57.478113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:59.395442 run osmo-stp_10.42.42.5(pid=23328): stderr: | 20221214073657667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073657667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073657667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073657668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073657668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073657668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073657668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:59.557458 run patchelf(pid=23331): Terminating (SIGINT) 07:36:59.746295 run patchelf(pid=23331): Terminated: ok {rc=0} 07:36:59.882476 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23328): Process ended prematurely: osmo-stp_10.42.42.5(pid=23328) [trial-2401↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23328)] [trial-2401↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 07:36:59.893214 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:36:59.922113 run osmo-hlr_10.42.42.2(pid=23325): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23325)] 07:36:59.972791 run osmo-hlr_10.42.42.2(pid=23325): stdout: | (launched: 2022-12-14_07:36:56.436384) 07:37:00.025327 run osmo-hlr_10.42.42.2(pid=23325): stderr: | 20221214073656631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073656631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073656631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073656631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073656631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073656631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073656643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073656651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073656651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073656651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:00.077742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23318): Terminating (SIGTERM) 07:37:00.120114 run iperf3-srv_10.42.42.10(pid=23319): Terminating (SIGTERM) 07:37:00.162455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23320): Terminating (SIGTERM) 07:37:00.204913 run iperf3-srv_10.42.42.10(pid=23321): Terminating (SIGTERM) 07:37:00.247292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23324): Terminating (SIGTERM) 07:37:00.289956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23327): Terminating (SIGTERM) 07:37:00.332547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23330): Terminating (SIGTERM) 07:37:00.375427 --- ParallelTerminationStrategy: PID 23318 died... 07:37:00.395735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23318): Terminated: ok {rc=0} 07:37:00.442898 --- ParallelTerminationStrategy: PID 23319 died... 07:37:00.462877 run iperf3-srv_10.42.42.10(pid=23319): Terminated {rc=256} 07:37:00.509112 --- ParallelTerminationStrategy: PID 23320 died... 07:37:00.528935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23320): Terminated: ok {rc=0} 07:37:00.575586 --- ParallelTerminationStrategy: PID 23321 died... 07:37:00.595620 run iperf3-srv_10.42.42.10(pid=23321): Terminated {rc=256} 07:37:00.642084 --- ParallelTerminationStrategy: PID 23324 died... 07:37:00.662147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23324): Terminated: ok {rc=0} 07:37:00.708486 --- ParallelTerminationStrategy: PID 23327 died... 07:37:00.728582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23327): Terminated: ok {rc=0} 07:37:00.775026 --- ParallelTerminationStrategy: PID 23330 died... 07:37:00.795130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23330): Terminated: ok {rc=0} 07:37:00.903096 bus /gobi_0: Setting Powered False 07:37:02.007733 bus /gobi_0: Setting Powered False 07:37:03.125451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx iperf3.py ---------------------------------------------- 07:37:04.273273 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:04.284651 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:37:04.334707 tst iperf3.py: using LAC 39396 07:37:04.457172 tst iperf3.py: using RAC 126 07:37:04.579782 tst iperf3.py: using CellId 39396 07:37:04.701075 tst iperf3.py: using BVCI 39397 07:37:04.815999 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:04.826802 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:04.837458 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:04.847952 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:04.858313 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:04.868600 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:04.879115 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:04.889501 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:04.899912 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:37:05.015939 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:37:05.224399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:05.534931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23332): Launched 07:37:05.806961 run iperf3-srv_10.42.42.10(pid=23333): Launched 07:37:05.923050 tst iperf3.py:8: start network... 07:37:06.130126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:06.608497 run create_hlr_db(pid=23334): Launched 07:37:06.734857 bus /gobi_6: Setting Powered False 07:37:07.795963 run create_hlr_db(pid=23334): Terminated: ok {rc=0} 07:37:08.248055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23336): Launched 07:37:08.581362 run osmo-hlr_10.42.42.2(pid=23337): Launched 07:37:08.710008 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:09.285533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23339): Launched 07:37:09.619635 run osmo-stp_10.42.42.5(pid=23340): Launched 07:37:09.746369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:10.316601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23342): Launched 07:37:10.445870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:10.726529 run patchelf(pid=23343): Launched 07:37:10.912837 run osmo-stp_10.42.42.5(pid=23340): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23340)] 07:37:11.052475 run osmo-stp_10.42.42.5(pid=23340): stdout: | (launched: 2022-12-14_07:37:09.558515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:11.194494 run osmo-stp_10.42.42.5(pid=23340): stderr: | 20221214073709749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073709750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073709750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073709750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073709751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073709751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073709751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:11.336592 run osmo-stp_10.42.42.5(pid=23340): stdout: | (launched: 2022-12-14_07:37:09.558515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:11.472321 run osmo-stp_10.42.42.5(pid=23340): stderr: | 20221214073709749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073709750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073709750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073709750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073709751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073709751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073709751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:11.633727 run patchelf(pid=23343): Terminating (SIGINT) 07:37:11.820674 run patchelf(pid=23343): Terminated: ok {rc=0} 07:37:11.955849 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23340): Process ended prematurely: osmo-stp_10.42.42.5(pid=23340) [trial-2401↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23340)] [trial-2401↪gprs:trx-umtrx↪iperf3.py:8] 07:37:11.966006 tst iperf3.py:8: Test FAILED (7.7 sec) 07:37:11.994457 run osmo-hlr_10.42.42.2(pid=23337): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23337)] 07:37:12.045381 run osmo-hlr_10.42.42.2(pid=23337): stdout: | (launched: 2022-12-14_07:37:08.520410) 07:37:12.097566 run osmo-hlr_10.42.42.2(pid=23337): stderr: | 20221214073708717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073708717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073708717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073708717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073708717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073708717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073708730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073708739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073708739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073708739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:12.150091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23332): Terminating (SIGTERM) 07:37:12.192075 run iperf3-srv_10.42.42.10(pid=23333): Terminating (SIGTERM) 07:37:12.234620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23336): Terminating (SIGTERM) 07:37:12.277089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23339): Terminating (SIGTERM) 07:37:12.319458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23342): Terminating (SIGTERM) 07:37:12.362096 --- ParallelTerminationStrategy: PID 23332 died... 07:37:12.382609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23332): Terminated: ok {rc=0} 07:37:12.429336 --- ParallelTerminationStrategy: PID 23333 died... 07:37:12.449331 run iperf3-srv_10.42.42.10(pid=23333): Terminated {rc=256} 07:37:12.495551 --- ParallelTerminationStrategy: PID 23336 died... 07:37:12.515624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23336): Terminated: ok {rc=0} 07:37:12.562129 --- ParallelTerminationStrategy: PID 23339 died... 07:37:12.582156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23339): Terminated: ok {rc=0} 07:37:12.629052 --- ParallelTerminationStrategy: PID 23342 died... 07:37:12.649205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23342): Terminated: ok {rc=0} 07:37:12.737943 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 07:37:13.892059 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:13.904160 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:37:13.954373 tst iperf3m4.py: using LAC 39397 07:37:14.086556 tst iperf3m4.py: using RAC 127 07:37:14.211985 tst iperf3m4.py: using CellId 39397 07:37:14.331860 tst iperf3m4.py: using BVCI 39398 07:37:14.444427 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:14.455218 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:14.465791 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:14.476175 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:14.486531 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:14.496859 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:14.507849 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:14.518274 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:14.528799 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:37:14.650994 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:37:14.776365 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:37:14.900016 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:37:15.022312 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:37:15.247530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:15.581981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23344): Launched 07:37:15.877753 run iperf3-srv_10.42.42.10(pid=23345): Launched 07:37:16.017408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:37:16.249357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:16.591566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23346): Launched 07:37:16.898415 run iperf3-srv_10.42.42.10(pid=23347): Launched 07:37:17.064201 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:37:17.323006 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:17.637298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23348): Launched 07:37:17.907658 run iperf3-srv_10.42.42.10(pid=23349): Launched 07:37:18.024261 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:37:18.231583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:18.543007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23350): Launched 07:37:18.814421 run iperf3-srv_10.42.42.10(pid=23351): Launched 07:37:18.932767 tst iperf3m4.py:8: start network... 07:37:19.139439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:19.618990 run create_hlr_db(pid=23352): Launched 07:37:19.746899 bus /gobi_6: Setting Powered False 07:37:20.808253 run create_hlr_db(pid=23352): Terminated: ok {rc=0} 07:37:21.260594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23354): Launched 07:37:21.595138 run osmo-hlr_10.42.42.2(pid=23355): Launched 07:37:21.724772 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:22.286740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23357): Launched 07:37:22.598642 run osmo-stp_10.42.42.5(pid=23358): Launched 07:37:22.717375 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:23.251718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23360): Launched 07:37:23.370818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:23.633926 run patchelf(pid=23361): Launched 07:37:23.807096 run osmo-stp_10.42.42.5(pid=23358): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23358)] 07:37:23.937280 run osmo-stp_10.42.42.5(pid=23358): stdout: | (launched: 2022-12-14_07:37:22.541323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:24.069446 run osmo-stp_10.42.42.5(pid=23358): stderr: | 20221214073722710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073722710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073722710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073722711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073722711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073722711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073722711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:24.201741 run osmo-stp_10.42.42.5(pid=23358): stdout: | (launched: 2022-12-14_07:37:22.541323) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:24.327472 run osmo-stp_10.42.42.5(pid=23358): stderr: | 20221214073722710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073722710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073722710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073722711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073722711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073722711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073722711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:24.477082 run patchelf(pid=23361): Terminating (SIGINT) 07:37:24.652100 run patchelf(pid=23361): Terminated: ok {rc=0} 07:37:24.778226 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23358): Process ended prematurely: osmo-stp_10.42.42.5(pid=23358) [trial-2401↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23358)] [trial-2401↪gprs:trx-umtrx↪iperf3m4.py:8] 07:37:24.787727 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:37:24.815155 run osmo-hlr_10.42.42.2(pid=23355): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23355)] 07:37:24.862508 run osmo-hlr_10.42.42.2(pid=23355): stdout: | (launched: 2022-12-14_07:37:21.534612) 07:37:24.911903 run osmo-hlr_10.42.42.2(pid=23355): stderr: | 20221214073721730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073721730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073721730 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073721730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073721730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073721730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073721742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073721752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073721752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073721752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:24.961641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23344): Terminating (SIGTERM) 07:37:25.001471 run iperf3-srv_10.42.42.10(pid=23345): Terminating (SIGTERM) 07:37:25.041229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23346): Terminating (SIGTERM) 07:37:25.081165 run iperf3-srv_10.42.42.10(pid=23347): Terminating (SIGTERM) 07:37:25.121092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23348): Terminating (SIGTERM) 07:37:25.160899 run iperf3-srv_10.42.42.10(pid=23349): Terminating (SIGTERM) 07:37:25.200638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23350): Terminating (SIGTERM) 07:37:25.240312 run iperf3-srv_10.42.42.10(pid=23351): Terminating (SIGTERM) 07:37:25.279818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23354): Terminating (SIGTERM) 07:37:25.319844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23357): Terminating (SIGTERM) 07:37:25.359534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23360): Terminating (SIGTERM) 07:37:25.399552 --- ParallelTerminationStrategy: PID 23344 died... 07:37:25.418678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23344): Terminated: ok {rc=0} 07:37:25.462935 --- ParallelTerminationStrategy: PID 23345 died... 07:37:25.481861 run iperf3-srv_10.42.42.10(pid=23345): Terminated {rc=256} 07:37:25.525886 --- ParallelTerminationStrategy: PID 23346 died... 07:37:25.544316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23346): Terminated: ok {rc=0} 07:37:25.588226 --- ParallelTerminationStrategy: PID 23347 died... 07:37:25.606733 run iperf3-srv_10.42.42.10(pid=23347): Terminated {rc=256} 07:37:25.650539 --- ParallelTerminationStrategy: PID 23348 died... 07:37:25.669052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23348): Terminated: ok {rc=0} 07:37:25.712574 --- ParallelTerminationStrategy: PID 23349 died... 07:37:25.731153 run iperf3-srv_10.42.42.10(pid=23349): Terminated {rc=256} 07:37:25.774764 --- ParallelTerminationStrategy: PID 23350 died... 07:37:25.793434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23350): Terminated: ok {rc=0} 07:37:25.837234 --- ParallelTerminationStrategy: PID 23351 died... 07:37:25.855653 run iperf3-srv_10.42.42.10(pid=23351): Terminated {rc=256} 07:37:25.899317 --- ParallelTerminationStrategy: PID 23354 died... 07:37:25.917998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23354): Terminated: ok {rc=0} 07:37:25.961880 --- ParallelTerminationStrategy: PID 23357 died... 07:37:25.980641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23357): Terminated: ok {rc=0} 07:37:26.024283 --- ParallelTerminationStrategy: PID 23360 died... 07:37:26.042959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23360): Terminated: ok {rc=0} 07:37:26.128628 bus /gobi_4: Setting Powered False 07:37:27.227778 bus /gobi_4: Setting Powered False 07:37:28.342453 bus /gobi_1: Setting Powered False 07:37:29.441549 bus /gobi_1: Setting Powered False 07:37:30.558870 bus /gobi_0: Setting Powered False 07:37:31.665503 bus /gobi_0: Setting Powered False 07:37:32.784661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx ping.py ---------------------------------------------- 07:37:33.885480 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:33.896542 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:37:33.945186 tst ping.py: using LAC 39398 07:37:34.074909 tst ping.py: using RAC 128 07:37:34.205607 tst ping.py: using CellId 39398 07:37:34.334076 tst ping.py: using BVCI 39399 07:37:34.455124 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:34.466512 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:34.477680 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:34.488689 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:34.499971 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:34.511157 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:34.522613 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:34.533818 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:37:34.655204 tst ping.py:19: start network... 07:37:34.875337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:35.380170 run create_hlr_db(pid=23362): Launched 07:37:35.504224 bus /gobi_6: Setting Powered False 07:37:36.568806 run create_hlr_db(pid=23362): Terminated: ok {rc=0} 07:37:37.005321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23364): Launched 07:37:37.309601 run osmo-hlr_10.42.42.2(pid=23366): Launched 07:37:37.426671 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:37.969297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23368): Launched 07:37:38.273318 run osmo-stp_10.42.42.5(pid=23369): Launched 07:37:38.388530 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:38.912592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23371): Launched 07:37:39.028703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:39.284685 run patchelf(pid=23372): Launched 07:37:39.454258 run osmo-stp_10.42.42.5(pid=23369): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23369)] 07:37:39.582341 run osmo-stp_10.42.42.5(pid=23369): stdout: | (launched: 2022-12-14_07:37:38.217269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:39.712590 run osmo-stp_10.42.42.5(pid=23369): stderr: | 20221214073738384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073738384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073738384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073738385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073738385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073738385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073738385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:39.842595 run osmo-stp_10.42.42.5(pid=23369): stdout: | (launched: 2022-12-14_07:37:38.217269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:39.966066 run osmo-stp_10.42.42.5(pid=23369): stderr: | 20221214073738384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073738384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073738384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073738385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073738385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073738385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073738385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:40.112331 run patchelf(pid=23372): Terminating (SIGINT) 07:37:40.283882 run patchelf(pid=23372): Terminated: ok {rc=0} 07:37:40.407858 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23369): Process ended prematurely: osmo-stp_10.42.42.5(pid=23369) [trial-2401↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23369)] [trial-2401↪gprs:trx-umtrx↪ping.py:22] 07:37:40.416649 tst ping.py:22: Test FAILED (6.5 sec) 07:37:40.443545 run osmo-hlr_10.42.42.2(pid=23366): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23366)] 07:37:40.491058 run osmo-hlr_10.42.42.2(pid=23366): stdout: | (launched: 2022-12-14_07:37:37.253180) 07:37:40.540336 run osmo-hlr_10.42.42.2(pid=23366): stderr: | 20221214073737428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073737428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073737428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073737428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073737428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073737428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073737441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073737451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073737451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073737451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:40.590550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23364): Terminating (SIGTERM) 07:37:40.630454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23368): Terminating (SIGTERM) 07:37:40.670876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23371): Terminating (SIGTERM) 07:37:40.711564 --- ParallelTerminationStrategy: PID 23364 died... 07:37:40.730707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23364): Terminated: ok {rc=0} 07:37:40.774669 --- ParallelTerminationStrategy: PID 23368 died... 07:37:40.793475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23368): Terminated: ok {rc=0} 07:37:40.837668 --- ParallelTerminationStrategy: PID 23371 died... 07:37:40.856441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23371): Terminated: ok {rc=0} 07:37:40.940501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 07:37:42.027612 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:42.040135 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:37:42.092204 tst ping_idle_ping.py: using LAC 39399 07:37:42.222664 tst ping_idle_ping.py: using RAC 129 07:37:42.353273 tst ping_idle_ping.py: using CellId 39399 07:37:42.481323 tst ping_idle_ping.py: using BVCI 39400 07:37:42.600461 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:42.612118 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:42.623270 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:42.634338 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:42.645865 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:42.657344 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:42.669142 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:37:42.680549 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:37:42.798484 tst ping_idle_ping.py:24: start network... 07:37:43.004016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:43.478438 run create_hlr_db(pid=23373): Launched 07:37:43.605716 bus /gobi_6: Setting Powered False 07:37:44.666339 run create_hlr_db(pid=23373): Terminated: ok {rc=0} 07:37:45.114147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23375): Launched 07:37:45.443007 run osmo-hlr_10.42.42.2(pid=23376): Launched 07:37:45.568509 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:46.170874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23378): Launched 07:37:46.515923 run osmo-stp_10.42.42.5(pid=23379): Launched 07:37:46.851102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:47.425645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23381): Launched 07:37:47.553225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:47.833462 run patchelf(pid=23382): Launched 07:37:48.017724 run osmo-stp_10.42.42.5(pid=23379): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23379)] 07:37:48.157725 run osmo-stp_10.42.42.5(pid=23379): stdout: | (launched: 2022-12-14_07:37:46.452801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:48.299383 run osmo-stp_10.42.42.5(pid=23379): stderr: | 20221214073746677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073746677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073746678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073746678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073746678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073746679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073746679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:48.440755 run osmo-stp_10.42.42.5(pid=23379): stdout: | (launched: 2022-12-14_07:37:46.452801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:48.575300 run osmo-stp_10.42.42.5(pid=23379): stderr: | 20221214073746677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073746677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073746678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073746678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073746678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073746679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073746679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:48.734951 run patchelf(pid=23382): Terminating (SIGINT) 07:37:48.920480 run patchelf(pid=23382): Terminated: ok {rc=0} 07:37:49.054377 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23379): Process ended prematurely: osmo-stp_10.42.42.5(pid=23379) [trial-2401↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23379)] [trial-2401↪gprs:trx-umtrx↪ping_idle_ping.py:27] 07:37:49.064006 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 07:37:49.092342 run osmo-hlr_10.42.42.2(pid=23376): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23376)] 07:37:49.143343 run osmo-hlr_10.42.42.2(pid=23376): stdout: | (launched: 2022-12-14_07:37:45.383295) 07:37:49.195881 run osmo-hlr_10.42.42.2(pid=23376): stderr: | 20221214073745577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073745577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073745577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073745577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073745577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073745577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073745590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073745600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073745601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073745601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:49.248545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23375): Terminating (SIGTERM) 07:37:49.290789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23378): Terminating (SIGTERM) 07:37:49.333437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23381): Terminating (SIGTERM) 07:37:49.376243 --- ParallelTerminationStrategy: PID 23375 died... 07:37:49.397036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23375): Terminated: ok {rc=0} 07:37:49.443664 --- ParallelTerminationStrategy: PID 23378 died... 07:37:49.463764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23378): Terminated: ok {rc=0} 07:37:49.510241 --- ParallelTerminationStrategy: PID 23381 died... 07:37:49.530275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23381): Terminated: ok {rc=0} 07:37:49.619612 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 07:37:50.920466 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:37:50.927087 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:37:50.959462 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:37:50.998389 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:37:51.082971 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:37:51.115354 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:37:51.153454 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:37:51.747305 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:37:51.797432 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:37:51.808265 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:37:51.856606 tst cs_paging_gprs_active.py: using LAC 39400 07:37:51.989967 tst cs_paging_gprs_active.py: using RAC 130 07:37:52.121588 tst cs_paging_gprs_active.py: using CellId 39400 07:37:52.252518 tst cs_paging_gprs_active.py: using BVCI 39401 07:37:52.374334 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:37:52.385809 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:37:52.396816 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:37:52.408031 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:37:52.419380 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:37:52.430862 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:37:52.442499 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:37:52.453941 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:37:52.465647 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:37:52.585265 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:37:52.707469 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:37:52.933106 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:53.267579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23386): Launched 07:37:53.557354 run iperf3-srv_10.42.42.10(pid=23387): Launched 07:37:53.683180 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:37:53.907359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:54.240206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23388): Launched 07:37:54.529633 run iperf3-srv_10.42.42.10(pid=23389): Launched 07:37:54.655922 tst cs_paging_gprs_active.py:38: start network... 07:37:54.881926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:55.398608 run create_hlr_db(pid=23390): Launched 07:37:55.525531 bus /gobi_6: Setting Powered False 07:37:56.591043 run create_hlr_db(pid=23390): Terminated: ok {rc=0} 07:37:57.033678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23392): Launched 07:37:57.346167 run osmo-hlr_10.42.42.2(pid=23393): Launched 07:37:57.466365 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:58.016508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23395): Launched 07:37:58.325701 run osmo-stp_10.42.42.5(pid=23396): Launched 07:37:58.444330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:58.980606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23398): Launched 07:37:59.099045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:59.361523 run patchelf(pid=23399): Launched 07:37:59.535035 run osmo-stp_10.42.42.5(pid=23396): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23396)] 07:37:59.666678 run osmo-stp_10.42.42.5(pid=23396): stdout: | (launched: 2022-12-14_07:37:58.268673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:59.800117 run osmo-stp_10.42.42.5(pid=23396): stderr: | 20221214073758437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073758437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073758437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073758438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073758438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073758438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073758438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:59.932751 run osmo-stp_10.42.42.5(pid=23396): stdout: | (launched: 2022-12-14_07:37:58.268673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:00.059945 run osmo-stp_10.42.42.5(pid=23396): stderr: | 20221214073758437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073758437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073758437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073758438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073758438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073758438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073758438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:00.210973 run patchelf(pid=23399): Terminating (SIGINT) 07:38:00.387934 run patchelf(pid=23399): Terminated: ok {rc=0} 07:38:00.515264 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23396): Process ended prematurely: osmo-stp_10.42.42.5(pid=23396) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23396)] [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:38:00.524606 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:38:00.551601 run osmo-hlr_10.42.42.2(pid=23393): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23393)] 07:38:00.599059 run osmo-hlr_10.42.42.2(pid=23393): stdout: | (launched: 2022-12-14_07:37:57.288711) 07:38:00.648015 run osmo-hlr_10.42.42.2(pid=23393): stderr: | 20221214073757462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073757462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073757462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073757462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073757462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073757462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073757474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073757483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073757483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073757483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:00.697282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23386): Terminating (SIGTERM) 07:38:00.736882 run iperf3-srv_10.42.42.10(pid=23387): Terminating (SIGTERM) 07:38:00.776599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23388): Terminating (SIGTERM) 07:38:00.816398 run iperf3-srv_10.42.42.10(pid=23389): Terminating (SIGTERM) 07:38:00.869639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23392): Terminating (SIGTERM) 07:38:00.928404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23395): Terminating (SIGTERM) 07:38:00.968795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23398): Terminating (SIGTERM) 07:38:01.009843 --- ParallelTerminationStrategy: PID 23386 died... 07:38:01.030834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23386): Terminated: ok {rc=0} 07:38:01.098219 --- ParallelTerminationStrategy: PID 23387 died... 07:38:01.117425 run iperf3-srv_10.42.42.10(pid=23387): Terminated {rc=256} 07:38:01.162058 --- ParallelTerminationStrategy: PID 23388 died... 07:38:01.181354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23388): Terminated: ok {rc=0} 07:38:01.225768 --- ParallelTerminationStrategy: PID 23389 died... 07:38:01.244897 run iperf3-srv_10.42.42.10(pid=23389): Terminated {rc=256} 07:38:01.289300 --- ParallelTerminationStrategy: PID 23392 died... 07:38:01.308615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23392): Terminated: ok {rc=0} 07:38:01.353125 --- ParallelTerminationStrategy: PID 23395 died... 07:38:01.372208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23395): Terminated: ok {rc=0} 07:38:01.416913 --- ParallelTerminationStrategy: PID 23398 died... 07:38:01.436260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23398): Terminated: ok {rc=0} 07:38:01.520170 bus /gobi_0: Setting Powered False 07:38:02.615226 bus /gobi_0: Setting Powered False 07:38:03.727617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:38:04.878103 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:04.890600 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:38:04.946064 tst iperf3.py: using LAC 39401 07:38:05.077788 tst iperf3.py: using RAC 131 07:38:05.208703 tst iperf3.py: using CellId 39401 07:38:05.340693 tst iperf3.py: using BVCI 39402 07:38:05.464195 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:05.475759 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:05.486994 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:05.498388 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:05.510069 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:05.521833 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:05.534130 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:05.545906 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:05.558006 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:38:05.678139 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:38:05.888028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:06.199455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23400): Launched 07:38:06.470415 run iperf3-srv_10.42.42.10(pid=23401): Launched 07:38:06.589837 tst iperf3.py:8: start network... 07:38:06.797758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:07.276460 run create_hlr_db(pid=23402): Launched 07:38:07.403719 bus /gobi_6: Setting Powered False 07:38:08.465679 run create_hlr_db(pid=23402): Terminated: ok {rc=0} 07:38:08.895462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23404): Launched 07:38:09.205411 run osmo-hlr_10.42.42.2(pid=23405): Launched 07:38:09.323152 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:09.864722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23407): Launched 07:38:10.174158 run osmo-stp_10.42.42.5(pid=23408): Launched 07:38:10.294268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:10.825210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23410): Launched 07:38:10.943621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:11.204094 run patchelf(pid=23411): Launched 07:38:11.376913 run osmo-stp_10.42.42.5(pid=23408): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23408)] 07:38:11.507232 run osmo-stp_10.42.42.5(pid=23408): stdout: | (launched: 2022-12-14_07:38:10.117293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:11.639377 run osmo-stp_10.42.42.5(pid=23408): stderr: | 20221214073810283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073810283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073810283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073810284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073810285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073810285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073810286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:11.771266 run osmo-stp_10.42.42.5(pid=23408): stdout: | (launched: 2022-12-14_07:38:10.117293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:11.897814 run osmo-stp_10.42.42.5(pid=23408): stderr: | 20221214073810283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073810283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073810283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073810284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073810285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073810285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073810286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:12.046667 run patchelf(pid=23411): Terminating (SIGINT) 07:38:12.220719 run patchelf(pid=23411): Terminated: ok {rc=0} 07:38:12.346638 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23408): Process ended prematurely: osmo-stp_10.42.42.5(pid=23408) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23408)] [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 07:38:12.356109 tst iperf3.py:8: Test FAILED (7.5 sec) 07:38:12.383192 run osmo-hlr_10.42.42.2(pid=23405): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23405)] 07:38:12.430518 run osmo-hlr_10.42.42.2(pid=23405): stdout: | (launched: 2022-12-14_07:38:09.148341) 07:38:12.479926 run osmo-hlr_10.42.42.2(pid=23405): stderr: | 20221214073809322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073809322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073809322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073809322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073809322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073809322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073809334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073809342 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073809342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073809342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:12.529845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23400): Terminating (SIGTERM) 07:38:12.569860 run iperf3-srv_10.42.42.10(pid=23401): Terminating (SIGTERM) 07:38:12.609755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23404): Terminating (SIGTERM) 07:38:12.649731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23407): Terminating (SIGTERM) 07:38:12.689564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23410): Terminating (SIGTERM) 07:38:12.729749 --- ParallelTerminationStrategy: PID 23400 died... 07:38:12.749069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23400): Terminated: ok {rc=0} 07:38:12.793133 --- ParallelTerminationStrategy: PID 23401 died... 07:38:12.811967 run iperf3-srv_10.42.42.10(pid=23401): Terminated {rc=256} 07:38:12.855779 --- ParallelTerminationStrategy: PID 23404 died... 07:38:12.874507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23404): Terminated: ok {rc=0} 07:38:12.918292 --- ParallelTerminationStrategy: PID 23407 died... 07:38:12.937075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23407): Terminated: ok {rc=0} 07:38:12.980764 --- ParallelTerminationStrategy: PID 23410 died... 07:38:12.999535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23410): Terminated: ok {rc=0} 07:38:13.085288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:38:14.234801 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:14.246463 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:38:14.296684 tst iperf3m4.py: using LAC 39402 07:38:14.419660 tst iperf3m4.py: using RAC 132 07:38:14.546202 tst iperf3m4.py: using CellId 39402 07:38:14.670575 tst iperf3m4.py: using BVCI 39403 07:38:14.785326 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:14.796414 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:14.807404 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:14.818358 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:14.829577 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:14.840531 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:14.851743 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:14.862776 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:14.873970 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:38:14.991937 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:38:15.111590 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:38:15.233508 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:38:15.352019 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:38:15.560878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:15.886138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23412): Launched 07:38:16.194266 run iperf3-srv_10.42.42.10(pid=23413): Launched 07:38:16.337941 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:38:16.570227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:16.921744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23414): Launched 07:38:17.205595 run iperf3-srv_10.42.42.10(pid=23415): Launched 07:38:17.333458 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:38:17.558904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:17.894947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23416): Launched 07:38:18.185894 run iperf3-srv_10.42.42.10(pid=23417): Launched 07:38:18.312498 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:38:18.537224 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:18.871300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23418): Launched 07:38:19.161287 run iperf3-srv_10.42.42.10(pid=23419): Launched 07:38:19.287570 tst iperf3m4.py:8: start network... 07:38:19.511360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:20.026209 run create_hlr_db(pid=23420): Launched 07:38:20.155021 bus /gobi_6: Setting Powered False 07:38:21.220067 run create_hlr_db(pid=23420): Terminated: ok {rc=0} 07:38:21.682215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23422): Launched 07:38:22.017307 run osmo-hlr_10.42.42.2(pid=23423): Launched 07:38:22.146121 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:22.720092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23425): Launched 07:38:23.055188 run osmo-stp_10.42.42.5(pid=23426): Launched 07:38:23.184422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:23.765685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23428): Launched 07:38:23.895753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:24.179340 run patchelf(pid=23429): Launched 07:38:24.353482 run osmo-stp_10.42.42.5(pid=23426): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23426)] 07:38:24.485507 run osmo-stp_10.42.42.5(pid=23426): stdout: | (launched: 2022-12-14_07:38:22.994176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:24.618858 run osmo-stp_10.42.42.5(pid=23426): stderr: | 20221214073823184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073823184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073823184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073823185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073823185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073823185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073823186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:24.751793 run osmo-stp_10.42.42.5(pid=23426): stdout: | (launched: 2022-12-14_07:38:22.994176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:24.878687 run osmo-stp_10.42.42.5(pid=23426): stderr: | 20221214073823184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073823184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073823184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073823185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073823185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073823185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073823186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:25.029090 run patchelf(pid=23429): Terminating (SIGINT) 07:38:25.205541 run patchelf(pid=23429): Terminated: ok {rc=0} 07:38:25.332577 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23426): Process ended prematurely: osmo-stp_10.42.42.5(pid=23426) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23426)] [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 07:38:25.342261 tst iperf3m4.py:8: Test FAILED (11.1 sec) 07:38:25.370481 run osmo-hlr_10.42.42.2(pid=23423): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23423)] 07:38:25.418102 run osmo-hlr_10.42.42.2(pid=23423): stdout: | (launched: 2022-12-14_07:38:21.956051) 07:38:25.467771 run osmo-hlr_10.42.42.2(pid=23423): stderr: | 20221214073822154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073822154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073822154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073822154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073822154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073822154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073822166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073822174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073822175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073822175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:25.518040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23412): Terminating (SIGTERM) 07:38:25.558301 run iperf3-srv_10.42.42.10(pid=23413): Terminating (SIGTERM) 07:38:25.598425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23414): Terminating (SIGTERM) 07:38:25.638837 run iperf3-srv_10.42.42.10(pid=23415): Terminating (SIGTERM) 07:38:25.679029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23416): Terminating (SIGTERM) 07:38:25.719288 run iperf3-srv_10.42.42.10(pid=23417): Terminating (SIGTERM) 07:38:25.759296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23418): Terminating (SIGTERM) 07:38:25.799333 run iperf3-srv_10.42.42.10(pid=23419): Terminating (SIGTERM) 07:38:25.839340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23422): Terminating (SIGTERM) 07:38:25.879569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23425): Terminating (SIGTERM) 07:38:25.920059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23428): Terminating (SIGTERM) 07:38:25.960647 --- ParallelTerminationStrategy: PID 23412 died... 07:38:25.980516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23412): Terminated: ok {rc=0} 07:38:26.024914 --- ParallelTerminationStrategy: PID 23413 died... 07:38:26.044179 run iperf3-srv_10.42.42.10(pid=23413): Terminated {rc=256} 07:38:26.087951 --- ParallelTerminationStrategy: PID 23414 died... 07:38:26.106722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23414): Terminated: ok {rc=0} 07:38:26.150608 --- ParallelTerminationStrategy: PID 23415 died... 07:38:26.169337 run iperf3-srv_10.42.42.10(pid=23415): Terminated {rc=256} 07:38:26.212943 --- ParallelTerminationStrategy: PID 23416 died... 07:38:26.232003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23416): Terminated: ok {rc=0} 07:38:26.275853 --- ParallelTerminationStrategy: PID 23417 died... 07:38:26.294631 run iperf3-srv_10.42.42.10(pid=23417): Terminated {rc=256} 07:38:26.338338 --- ParallelTerminationStrategy: PID 23418 died... 07:38:26.357261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23418): Terminated: ok {rc=0} 07:38:26.401063 --- ParallelTerminationStrategy: PID 23419 died... 07:38:26.419830 run iperf3-srv_10.42.42.10(pid=23419): Terminated {rc=256} 07:38:26.463672 --- ParallelTerminationStrategy: PID 23422 died... 07:38:26.482467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23422): Terminated: ok {rc=0} 07:38:26.526629 --- ParallelTerminationStrategy: PID 23425 died... 07:38:26.545581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23425): Terminated: ok {rc=0} 07:38:26.589566 --- ParallelTerminationStrategy: PID 23428 died... 07:38:26.608289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23428): Terminated: ok {rc=0} 07:38:26.694639 bus /gobi_4: Setting Powered False 07:38:27.795233 bus /gobi_4: Setting Powered False 07:38:28.911443 bus /gobi_1: Setting Powered False 07:38:30.010750 bus /gobi_1: Setting Powered False 07:38:31.128474 bus /gobi_0: Setting Powered False 07:38:32.230117 bus /gobi_0: Setting Powered False 07:38:33.347520 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 07:38:34.450877 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:34.463301 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:38:34.514773 tst ping.py: using LAC 39403 07:38:34.642106 tst ping.py: using RAC 133 07:38:34.760751 tst ping.py: using CellId 39403 07:38:34.878636 tst ping.py: using BVCI 39404 07:38:34.989952 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:35.001139 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:35.012008 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:35.022930 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:35.033874 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:35.044555 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:35.055554 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:35.066508 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:38:35.186547 tst ping.py:19: start network... 07:38:35.407025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:35.913188 run create_hlr_db(pid=23430): Launched 07:38:36.040445 bus /gobi_6: Setting Powered False 07:38:37.105103 run create_hlr_db(pid=23430): Terminated: ok {rc=0} 07:38:37.543620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23432): Launched 07:38:37.849122 run osmo-hlr_10.42.42.2(pid=23433): Launched 07:38:37.964762 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:38.495069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23435): Launched 07:38:38.799086 run osmo-stp_10.42.42.5(pid=23436): Launched 07:38:38.914003 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:39.435442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23438): Launched 07:38:39.551676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:39.807667 run patchelf(pid=23439): Launched 07:38:39.976860 run osmo-stp_10.42.42.5(pid=23436): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23436)] 07:38:40.105948 run osmo-stp_10.42.42.5(pid=23436): stdout: | (launched: 2022-12-14_07:38:38.742769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:40.236253 run osmo-stp_10.42.42.5(pid=23436): stderr: | 20221214073838911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073838911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073838911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073838912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073838912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073838912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073838912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:40.366433 run osmo-stp_10.42.42.5(pid=23436): stdout: | (launched: 2022-12-14_07:38:38.742769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:40.489889 run osmo-stp_10.42.42.5(pid=23436): stderr: | 20221214073838911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073838911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073838911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073838912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073838912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073838912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073838912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:40.636362 run patchelf(pid=23439): Terminating (SIGINT) 07:38:40.808172 run patchelf(pid=23439): Terminated: ok {rc=0} 07:38:40.931844 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23436): Process ended prematurely: osmo-stp_10.42.42.5(pid=23436) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23436)] [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 07:38:40.940715 tst ping.py:22: Test FAILED (6.5 sec) 07:38:40.967323 run osmo-hlr_10.42.42.2(pid=23433): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23433)] 07:38:41.014660 run osmo-hlr_10.42.42.2(pid=23433): stdout: | (launched: 2022-12-14_07:38:37.792878) 07:38:41.063737 run osmo-hlr_10.42.42.2(pid=23433): stderr: | 20221214073837968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073837968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073837968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073837968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073837968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073837968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073837980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073837988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073837988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073837989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:41.113286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23432): Terminating (SIGTERM) 07:38:41.153080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23435): Terminating (SIGTERM) 07:38:41.193060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23438): Terminating (SIGTERM) 07:38:41.233310 --- ParallelTerminationStrategy: PID 23432 died... 07:38:41.252236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23432): Terminated: ok {rc=0} 07:38:41.296706 --- ParallelTerminationStrategy: PID 23435 died... 07:38:41.315622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23435): Terminated: ok {rc=0} 07:38:41.359525 --- ParallelTerminationStrategy: PID 23438 died... 07:38:41.378288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23438): Terminated: ok {rc=0} 07:38:41.461941 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:38:42.546388 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:42.558119 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:38:42.608314 tst ping_idle_ping.py: using LAC 39404 07:38:42.729574 tst ping_idle_ping.py: using RAC 134 07:38:42.860891 tst ping_idle_ping.py: using CellId 39404 07:38:42.984694 tst ping_idle_ping.py: using BVCI 39405 07:38:43.105530 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:43.117119 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:43.128467 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:43.139837 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:43.151715 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:43.163952 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:43.176185 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:38:43.188414 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:38:43.308504 tst ping_idle_ping.py:24: start network... 07:38:43.513014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:43.986070 run create_hlr_db(pid=23440): Launched 07:38:44.115106 bus /gobi_6: Setting Powered False 07:38:45.175752 run create_hlr_db(pid=23440): Terminated: ok {rc=0} 07:38:45.625522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23442): Launched 07:38:45.976495 run osmo-hlr_10.42.42.2(pid=23443): Launched 07:38:46.200205 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:46.853791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23445): Launched 07:38:47.192036 run osmo-stp_10.42.42.5(pid=23446): Launched 07:38:47.386638 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:47.919749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23448): Launched 07:38:48.047692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:48.326029 run patchelf(pid=23449): Launched 07:38:48.510173 run osmo-stp_10.42.42.5(pid=23446): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23446)] 07:38:48.649524 run osmo-stp_10.42.42.5(pid=23446): stdout: | (launched: 2022-12-14_07:38:47.131315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:48.790011 run osmo-stp_10.42.42.5(pid=23446): stderr: | 20221214073847338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073847338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073847338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073847339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073847339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073847339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073847339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:48.930008 run osmo-stp_10.42.42.5(pid=23446): stdout: | (launched: 2022-12-14_07:38:47.131315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:49.063919 run osmo-stp_10.42.42.5(pid=23446): stderr: | 20221214073847338 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073847338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073847338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073847339 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073847339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073847339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073847339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:49.222437 run patchelf(pid=23449): Terminating (SIGINT) 07:38:49.406897 run patchelf(pid=23449): Terminated: ok {rc=0} 07:38:49.539458 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23446): Process ended prematurely: osmo-stp_10.42.42.5(pid=23446) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23446)] [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 07:38:49.549225 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 07:38:49.577573 run osmo-hlr_10.42.42.2(pid=23443): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23443)] 07:38:49.628758 run osmo-hlr_10.42.42.2(pid=23443): stdout: | (launched: 2022-12-14_07:38:45.915173) 07:38:49.681872 run osmo-hlr_10.42.42.2(pid=23443): stderr: | 20221214073846239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073846239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073846239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073846239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073846239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073846239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073846261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073846278 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073846278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073846278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:49.735288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23442): Terminating (SIGTERM) 07:38:49.777217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23445): Terminating (SIGTERM) 07:38:49.820115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23448): Terminating (SIGTERM) 07:38:49.863043 --- ParallelTerminationStrategy: PID 23442 died... 07:38:49.883849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23442): Terminated: ok {rc=0} 07:38:49.931335 --- ParallelTerminationStrategy: PID 23445 died... 07:38:49.951448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23445): Terminated: ok {rc=0} 07:38:49.997838 --- ParallelTerminationStrategy: PID 23448 died... 07:38:50.018014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23448): Terminated: ok {rc=0} 07:38:50.107021 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:38:51.411202 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:38:51.417944 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:38:51.451029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:38:51.491882 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:38:51.581072 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:38:51.614344 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:38:51.654302 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:38:52.251061 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:38:52.307470 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:38:52.319066 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:38:52.389332 tst cs_paging_gprs_active.py: using LAC 39405 07:38:52.517786 tst cs_paging_gprs_active.py: using RAC 135 07:38:52.648217 tst cs_paging_gprs_active.py: using CellId 39405 07:38:52.777597 tst cs_paging_gprs_active.py: using BVCI 39406 07:38:52.891421 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:38:52.902586 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:38:52.913685 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:38:52.924421 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:38:52.935250 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:38:52.946228 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:38:52.957050 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:38:52.967693 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:38:52.978653 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:38:53.102403 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:38:53.221778 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:38:53.431379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:53.743244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23453): Launched 07:38:54.014520 run iperf3-srv_10.42.42.10(pid=23454): Launched 07:38:54.133875 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:38:54.342423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:38:54.653602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23455): Launched 07:38:54.925607 run iperf3-srv_10.42.42.10(pid=23456): Launched 07:38:55.043026 tst cs_paging_gprs_active.py:38: start network... 07:38:55.252424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:55.735950 run create_hlr_db(pid=23457): Launched 07:38:55.863170 bus /gobi_6: Setting Powered False 07:38:56.924310 run create_hlr_db(pid=23457): Terminated: ok {rc=0} 07:38:57.378120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23459): Launched 07:38:57.712746 run osmo-hlr_10.42.42.2(pid=23460): Launched 07:38:57.841138 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:58.415071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23462): Launched 07:38:58.734328 run osmo-stp_10.42.42.5(pid=23463): Launched 07:38:58.854819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:59.389193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23465): Launched 07:38:59.507871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:59.777204 run patchelf(pid=23466): Launched 07:38:59.950618 run osmo-stp_10.42.42.5(pid=23463): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23463)] 07:39:00.082056 run osmo-stp_10.42.42.5(pid=23463): stdout: | (launched: 2022-12-14_07:38:58.676410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:00.214390 run osmo-stp_10.42.42.5(pid=23463): stderr: | 20221214073858844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073858845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073858845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073858845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073858846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073858846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073858846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:00.347464 run osmo-stp_10.42.42.5(pid=23463): stdout: | (launched: 2022-12-14_07:38:58.676410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:00.474295 run osmo-stp_10.42.42.5(pid=23463): stderr: | 20221214073858844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073858845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073858845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073858845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073858846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073858846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073858846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:00.624047 run patchelf(pid=23466): Terminating (SIGINT) 07:39:00.799374 run patchelf(pid=23466): Terminated: ok {rc=0} 07:39:00.940758 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23463): Process ended prematurely: osmo-stp_10.42.42.5(pid=23463) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23463)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:39:00.950648 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:39:00.978795 run osmo-hlr_10.42.42.2(pid=23460): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23460)] 07:39:01.027417 run osmo-hlr_10.42.42.2(pid=23460): stdout: | (launched: 2022-12-14_07:38:57.651482) 07:39:01.078312 run osmo-hlr_10.42.42.2(pid=23460): stderr: | 20221214073857847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073857847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073857847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073857848 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073857848 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073857848 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073857859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073857868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073857869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073857869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:01.129233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23453): Terminating (SIGTERM) 07:39:01.169952 run iperf3-srv_10.42.42.10(pid=23454): Terminating (SIGTERM) 07:39:01.210588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23455): Terminating (SIGTERM) 07:39:01.251709 run iperf3-srv_10.42.42.10(pid=23456): Terminating (SIGTERM) 07:39:01.295372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23459): Terminating (SIGTERM) 07:39:01.337192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23462): Terminating (SIGTERM) 07:39:01.379639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23465): Terminating (SIGTERM) 07:39:01.421083 --- ParallelTerminationStrategy: PID 23453 died... 07:39:01.440374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23453): Terminated: ok {rc=0} 07:39:01.485294 --- ParallelTerminationStrategy: PID 23454 died... 07:39:01.504224 run iperf3-srv_10.42.42.10(pid=23454): Terminated {rc=256} 07:39:01.562588 --- ParallelTerminationStrategy: PID 23455 died... 07:39:01.582078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23455): Terminated: ok {rc=0} 07:39:01.626998 --- ParallelTerminationStrategy: PID 23456 died... 07:39:01.648412 run iperf3-srv_10.42.42.10(pid=23456): Terminated {rc=256} 07:39:01.700772 --- ParallelTerminationStrategy: PID 23459 died... 07:39:01.723677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23459): Terminated: ok {rc=0} 07:39:01.787428 --- ParallelTerminationStrategy: PID 23462 died... 07:39:01.814946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23462): Terminated: ok {rc=0} 07:39:01.872700 --- ParallelTerminationStrategy: PID 23465 died... 07:39:01.896178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23465): Terminated: ok {rc=0} 07:39:02.004416 bus /gobi_0: Setting Powered False 07:39:03.137531 bus /gobi_0: Setting Powered False 07:39:04.274119 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:39:05.424269 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:05.436940 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:39:05.509425 tst iperf3.py: using LAC 39406 07:39:05.640517 tst iperf3.py: using RAC 136 07:39:05.772146 tst iperf3.py: using CellId 39406 07:39:05.903636 tst iperf3.py: using BVCI 39407 07:39:06.027143 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:06.039593 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:06.051849 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:06.064242 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:06.077670 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:06.091144 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:06.104258 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:06.117604 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:06.130692 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:39:06.257885 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:39:06.488316 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:06.825469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23738): Launched 07:39:07.129111 run iperf3-srv_10.42.42.10(pid=23739): Launched 07:39:07.269974 tst iperf3.py:8: start network... 07:39:07.497405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:08.018466 run create_hlr_db(pid=23740): Launched 07:39:08.185587 bus /gobi_6: Setting Powered False 07:39:09.253370 run create_hlr_db(pid=23740): Terminated: ok {rc=0} 07:39:09.729152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23742): Launched 07:39:10.080475 run osmo-hlr_10.42.42.2(pid=23743): Launched 07:39:10.338049 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:11.124599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23745): Launched 07:39:11.467425 run osmo-stp_10.42.42.5(pid=23746): Launched 07:39:11.720057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:39:12.381774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23748): Launched 07:39:12.516016 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:39:12.800640 run patchelf(pid=23749): Launched 07:39:12.998671 run osmo-stp_10.42.42.5(pid=23746): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23746)] 07:39:13.141358 run osmo-stp_10.42.42.5(pid=23746): stdout: | (launched: 2022-12-14_07:39:11.407394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:13.287262 run osmo-stp_10.42.42.5(pid=23746): stderr: | 20221214073911700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073911700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073911700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073911701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073911709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073911709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073911709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:13.430741 run osmo-stp_10.42.42.5(pid=23746): stdout: | (launched: 2022-12-14_07:39:11.407394) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:13.569221 run osmo-stp_10.42.42.5(pid=23746): stderr: | 20221214073911700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073911700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073911700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073911701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073911709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073911709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073911709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:13.735204 run patchelf(pid=23749): Terminating (SIGINT) 07:39:13.923778 run patchelf(pid=23749): Terminated: ok {rc=0} 07:39:14.061217 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23746): Process ended prematurely: osmo-stp_10.42.42.5(pid=23746) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23746)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 07:39:14.072602 tst iperf3.py:8: Test FAILED (8.7 sec) 07:39:14.104904 run osmo-hlr_10.42.42.2(pid=23743): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23743)] 07:39:14.158428 run osmo-hlr_10.42.42.2(pid=23743): stdout: | (launched: 2022-12-14_07:39:10.019279) 07:39:14.214224 run osmo-hlr_10.42.42.2(pid=23743): stderr: | 20221214073910333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073910333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073910333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073910333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073910333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073910333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073910352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073910360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073910360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073910360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:14.269626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23738): Terminating (SIGTERM) 07:39:14.314817 run iperf3-srv_10.42.42.10(pid=23739): Terminating (SIGTERM) 07:39:14.362031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23742): Terminating (SIGTERM) 07:39:14.407399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23745): Terminating (SIGTERM) 07:39:14.453967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23748): Terminating (SIGTERM) 07:39:14.501958 --- ParallelTerminationStrategy: PID 23738 died... 07:39:14.523954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23738): Terminated: ok {rc=0} 07:39:14.575434 --- ParallelTerminationStrategy: PID 23739 died... 07:39:14.596573 run iperf3-srv_10.42.42.10(pid=23739): Terminated {rc=256} 07:39:14.645726 --- ParallelTerminationStrategy: PID 23742 died... 07:39:14.668405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23742): Terminated: ok {rc=0} 07:39:14.720615 --- ParallelTerminationStrategy: PID 23745 died... 07:39:14.741895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23745): Terminated: ok {rc=0} 07:39:14.790642 --- ParallelTerminationStrategy: PID 23748 died... 07:39:14.812296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23748): Terminated: ok {rc=0} 07:39:14.907040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:39:16.099553 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:16.116370 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:39:16.204374 tst iperf3m4.py: using LAC 39407 07:39:16.367116 tst iperf3m4.py: using RAC 137 07:39:16.515332 tst iperf3m4.py: using CellId 39407 07:39:16.679334 tst iperf3m4.py: using BVCI 39408 07:39:16.838823 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:16.851395 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:16.863938 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:16.876303 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:16.890778 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:16.903763 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:16.918337 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:16.930600 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:16.943701 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:39:17.095066 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:39:17.267502 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:39:17.409385 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:39:17.549169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:39:17.773689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:18.089717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23750): Launched 07:39:18.371279 run iperf3-srv_10.42.42.10(pid=23751): Launched 07:39:18.502797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:39:18.709824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:19.026142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Launched 07:39:19.314211 run iperf3-srv_10.42.42.10(pid=23753): Launched 07:39:19.446477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:39:19.653222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:19.970343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Launched 07:39:20.253951 run iperf3-srv_10.42.42.10(pid=23755): Launched 07:39:20.384738 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:39:20.593037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:20.907969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23756): Launched 07:39:21.191373 run iperf3-srv_10.42.42.10(pid=23757): Launched 07:39:21.323369 tst iperf3m4.py:8: start network... 07:39:21.529948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:22.013480 run create_hlr_db(pid=23758): Launched 07:39:22.173562 bus /gobi_6: Setting Powered False 07:39:23.238490 run create_hlr_db(pid=23758): Terminated: ok {rc=0} 07:39:23.682818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23760): Launched 07:39:24.029060 run osmo-hlr_10.42.42.2(pid=23761): Launched 07:39:24.279310 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:24.943502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23763): Launched 07:39:25.286937 run osmo-stp_10.42.42.5(pid=23764): Launched 07:39:25.534459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:39:26.101240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23767): Launched 07:39:26.219213 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:39:26.477742 run patchelf(pid=23768): Launched 07:39:26.647655 run osmo-stp_10.42.42.5(pid=23764): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23764)] 07:39:26.776264 run osmo-stp_10.42.42.5(pid=23764): stdout: | (launched: 2022-12-14_07:39:25.225929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:26.906716 run osmo-stp_10.42.42.5(pid=23764): stderr: | 20221214073925525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073925525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073925525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073925526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073925526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073925526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073925527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:27.036869 run osmo-stp_10.42.42.5(pid=23764): stdout: | (launched: 2022-12-14_07:39:25.225929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:27.161189 run osmo-stp_10.42.42.5(pid=23764): stderr: | 20221214073925525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073925525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073925525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073925526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073925526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073925526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073925527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:27.308306 run patchelf(pid=23768): Terminating (SIGINT) 07:39:27.480356 run patchelf(pid=23768): Terminated: ok {rc=0} 07:39:27.604761 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23764): Process ended prematurely: osmo-stp_10.42.42.5(pid=23764) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23764)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:39:27.614453 tst iperf3m4.py:8: Test FAILED (11.6 sec) 07:39:27.641949 run osmo-hlr_10.42.42.2(pid=23761): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23761)] 07:39:27.689701 run osmo-hlr_10.42.42.2(pid=23761): stdout: | (launched: 2022-12-14_07:39:23.965352) 07:39:27.739254 run osmo-hlr_10.42.42.2(pid=23761): stderr: | 20221214073924271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073924272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073924272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073924272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073924272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073924272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073924291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073924308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073924308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073924308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:27.789282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23750): Terminating (SIGTERM) 07:39:27.829169 run iperf3-srv_10.42.42.10(pid=23751): Terminating (SIGTERM) 07:39:27.870587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminating (SIGTERM) 07:39:27.911260 run iperf3-srv_10.42.42.10(pid=23753): Terminating (SIGTERM) 07:39:27.951515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Terminating (SIGTERM) 07:39:27.990999 run iperf3-srv_10.42.42.10(pid=23755): Terminating (SIGTERM) 07:39:28.030339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23756): Terminating (SIGTERM) 07:39:28.069874 run iperf3-srv_10.42.42.10(pid=23757): Terminating (SIGTERM) 07:39:28.109369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23760): Terminating (SIGTERM) 07:39:28.149109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23763): Terminating (SIGTERM) 07:39:28.188542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23767): Terminating (SIGTERM) 07:39:28.228257 --- ParallelTerminationStrategy: PID 23750 died... 07:39:28.247193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23750): Terminated: ok {rc=0} 07:39:28.290924 --- ParallelTerminationStrategy: PID 23751 died... 07:39:28.309330 run iperf3-srv_10.42.42.10(pid=23751): Terminated {rc=256} 07:39:28.352690 --- ParallelTerminationStrategy: PID 23752 died... 07:39:28.371038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminated: ok {rc=0} 07:39:28.414431 --- ParallelTerminationStrategy: PID 23753 died... 07:39:28.432732 run iperf3-srv_10.42.42.10(pid=23753): Terminated {rc=256} 07:39:28.476777 --- ParallelTerminationStrategy: PID 23754 died... 07:39:28.495370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23754): Terminated: ok {rc=0} 07:39:28.538879 --- ParallelTerminationStrategy: PID 23755 died... 07:39:28.557275 run iperf3-srv_10.42.42.10(pid=23755): Terminated {rc=256} 07:39:28.600621 --- ParallelTerminationStrategy: PID 23756 died... 07:39:28.619068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23756): Terminated: ok {rc=0} 07:39:28.662576 --- ParallelTerminationStrategy: PID 23757 died... 07:39:28.681357 run iperf3-srv_10.42.42.10(pid=23757): Terminated {rc=256} 07:39:28.725181 --- ParallelTerminationStrategy: PID 23760 died... 07:39:28.743495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23760): Terminated: ok {rc=0} 07:39:28.787061 --- ParallelTerminationStrategy: PID 23763 died... 07:39:28.805418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23763): Terminated: ok {rc=0} 07:39:28.848737 --- ParallelTerminationStrategy: PID 23767 died... 07:39:28.867234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23767): Terminated: ok {rc=0} 07:39:28.950347 bus /gobi_4: Setting Powered False 07:39:30.048221 bus /gobi_4: Setting Powered False 07:39:31.174092 bus /gobi_1: Setting Powered False 07:39:32.287714 bus /gobi_1: Setting Powered False 07:39:33.402733 bus /gobi_0: Setting Powered False 07:39:34.501645 bus /gobi_0: Setting Powered False 07:39:35.618013 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:39:36.719899 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:36.731607 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:39:36.801168 tst ping.py: using LAC 39408 07:39:36.918585 tst ping.py: using RAC 138 07:39:37.037145 tst ping.py: using CellId 39408 07:39:37.164118 tst ping.py: using BVCI 39409 07:39:37.280630 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:37.292310 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:37.303723 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:37.315425 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:37.327123 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:37.338770 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:37.350472 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:37.362006 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:39:37.478502 tst ping.py:19: start network... 07:39:37.680082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:38.148028 run create_hlr_db(pid=23769): Launched 07:39:38.271373 bus /gobi_6: Setting Powered False 07:39:39.330679 run create_hlr_db(pid=23769): Terminated: ok {rc=0} 07:39:39.771477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23771): Launched 07:39:40.094034 run osmo-hlr_10.42.42.2(pid=23772): Launched 07:39:40.218033 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:40.772135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23774): Launched 07:39:41.095261 run osmo-stp_10.42.42.5(pid=23775): Launched 07:39:41.218833 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:39:41.780204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23777): Launched 07:39:41.905439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:39:42.177001 run patchelf(pid=23778): Launched 07:39:42.357423 run osmo-stp_10.42.42.5(pid=23775): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23775)] 07:39:42.493545 run osmo-stp_10.42.42.5(pid=23775): stdout: | (launched: 2022-12-14_07:39:41.035674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:42.631600 run osmo-stp_10.42.42.5(pid=23775): stderr: | 20221214073941228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073941228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073941228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073941229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073941229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073941229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073941229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:42.770239 run osmo-stp_10.42.42.5(pid=23775): stdout: | (launched: 2022-12-14_07:39:41.035674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:42.901510 run osmo-stp_10.42.42.5(pid=23775): stderr: | 20221214073941228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073941228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073941228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073941229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073941229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073941229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073941229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:43.057003 run patchelf(pid=23778): Terminating (SIGINT) 07:39:43.238169 run patchelf(pid=23778): Terminated: ok {rc=0} 07:39:43.368749 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23775): Process ended prematurely: osmo-stp_10.42.42.5(pid=23775) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23775)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 07:39:43.378592 tst ping.py:22: Test FAILED (6.7 sec) 07:39:43.406756 run osmo-hlr_10.42.42.2(pid=23772): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23772)] 07:39:43.457649 run osmo-hlr_10.42.42.2(pid=23772): stdout: | (launched: 2022-12-14_07:39:40.034256) 07:39:43.510329 run osmo-hlr_10.42.42.2(pid=23772): stderr: | 20221214073940235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073940235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073940235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073940235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073940235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073940235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073940245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073940253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073940254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073940254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:43.563385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23771): Terminating (SIGTERM) 07:39:43.605458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23774): Terminating (SIGTERM) 07:39:43.648012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23777): Terminating (SIGTERM) 07:39:43.690998 --- ParallelTerminationStrategy: PID 23771 died... 07:39:43.711343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23771): Terminated: ok {rc=0} 07:39:43.758299 --- ParallelTerminationStrategy: PID 23774 died... 07:39:43.778325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23774): Terminated: ok {rc=0} 07:39:43.824653 --- ParallelTerminationStrategy: PID 23777 died... 07:39:43.844652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23777): Terminated: ok {rc=0} 07:39:43.932356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:39:45.020628 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:45.033016 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:39:45.113731 tst ping_idle_ping.py: using LAC 39409 07:39:45.240743 tst ping_idle_ping.py: using RAC 139 07:39:45.366455 tst ping_idle_ping.py: using CellId 39409 07:39:45.492752 tst ping_idle_ping.py: using BVCI 39410 07:39:45.610137 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:45.621843 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:45.633329 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:45.644620 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:45.656783 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:45.669423 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:45.681809 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:39:45.694029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:39:45.814314 tst ping_idle_ping.py:24: start network... 07:39:46.026461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:46.508805 run create_hlr_db(pid=23779): Launched 07:39:46.645145 bus /gobi_6: Setting Powered False 07:39:47.705083 run create_hlr_db(pid=23779): Terminated: ok {rc=0} 07:39:48.146452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23781): Launched 07:39:48.468327 run osmo-hlr_10.42.42.2(pid=23782): Launched 07:39:48.592172 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:49.147345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23784): Launched 07:39:49.471662 run osmo-stp_10.42.42.5(pid=23785): Launched 07:39:49.594504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:39:50.152440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23787): Launched 07:39:50.277686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:39:50.550349 run patchelf(pid=23788): Launched 07:39:50.730114 run osmo-stp_10.42.42.5(pid=23785): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23785)] 07:39:50.866427 run osmo-stp_10.42.42.5(pid=23785): stdout: | (launched: 2022-12-14_07:39:49.411414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:51.004510 run osmo-stp_10.42.42.5(pid=23785): stderr: | 20221214073949603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073949603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073949604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073949604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073949605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073949605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073949605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:51.142759 run osmo-stp_10.42.42.5(pid=23785): stdout: | (launched: 2022-12-14_07:39:49.411414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:51.274335 run osmo-stp_10.42.42.5(pid=23785): stderr: | 20221214073949603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214073949603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214073949604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214073949604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214073949605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214073949605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214073949605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:51.430423 run patchelf(pid=23788): Terminating (SIGINT) 07:39:51.612386 run patchelf(pid=23788): Terminated: ok {rc=0} 07:39:51.743911 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23785): Process ended prematurely: osmo-stp_10.42.42.5(pid=23785) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23785)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:39:51.753693 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:39:51.781847 run osmo-hlr_10.42.42.2(pid=23782): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23782)] 07:39:51.832748 run osmo-hlr_10.42.42.2(pid=23782): stdout: | (launched: 2022-12-14_07:39:48.408810) 07:39:51.885713 run osmo-hlr_10.42.42.2(pid=23782): stderr: | 20221214073948606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214073948606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214073948606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214073948606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214073948606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214073948606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214073948618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214073948626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214073948627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214073948627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:51.938564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23781): Terminating (SIGTERM) 07:39:51.980484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23784): Terminating (SIGTERM) 07:39:52.023163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23787): Terminating (SIGTERM) 07:39:52.065545 --- ParallelTerminationStrategy: PID 23781 died... 07:39:52.086071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23781): Terminated: ok {rc=0} 07:39:52.132807 --- ParallelTerminationStrategy: PID 23784 died... 07:39:52.152475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23784): Terminated: ok {rc=0} 07:39:52.199138 --- ParallelTerminationStrategy: PID 23787 died... 07:39:52.219125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23787): Terminated: ok {rc=0} 07:39:52.308907 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:39:53.616230 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:39:53.623010 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:39:53.656035 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:39:53.696601 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:39:53.785738 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:39:53.818558 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:39:53.857938 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:39:54.456427 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:39:54.509823 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:39:54.521229 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:39:54.591933 tst cs_paging_gprs_active.py: using LAC 39410 07:39:54.721101 tst cs_paging_gprs_active.py: using RAC 140 07:39:54.851055 tst cs_paging_gprs_active.py: using CellId 39410 07:39:54.981339 tst cs_paging_gprs_active.py: using BVCI 39411 07:39:55.101632 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:39:55.113074 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:39:55.124343 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:39:55.135708 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:39:55.147209 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:39:55.158906 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:39:55.170692 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:39:55.182266 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:39:55.194114 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:39:55.312790 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:39:55.440364 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:39:55.662916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:55.994267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23794): Launched 07:39:56.281429 run iperf3-srv_10.42.42.10(pid=23795): Launched 07:39:56.407422 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:39:56.630469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:39:56.964382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23796): Launched 07:39:57.250596 run iperf3-srv_10.42.42.10(pid=23797): Launched 07:39:57.374118 tst cs_paging_gprs_active.py:38: start network... 07:39:57.595388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:58.104672 run create_hlr_db(pid=23798): Launched 07:39:58.232055 bus /gobi_6: Setting Powered False 07:39:59.297093 run create_hlr_db(pid=23798): Terminated: ok {rc=0} 07:39:59.736859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23800): Launched 07:40:00.044705 run osmo-hlr_10.42.42.2(pid=23801): Launched 07:40:00.162474 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:00.691868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23803): Launched 07:40:01.017744 run osmo-stp_10.42.42.5(pid=23804): Launched 07:40:01.304506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:40:01.922404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23809): Launched 07:40:02.086069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:40:02.375796 run patchelf(pid=23810): Launched 07:40:02.548306 run osmo-stp_10.42.42.5(pid=23804): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23804)] 07:40:02.677974 run osmo-stp_10.42.42.5(pid=23804): stdout: | (launched: 2022-12-14_07:40:00.959412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:02.809172 run osmo-stp_10.42.42.5(pid=23804): stderr: | 20221214074001145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074001145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074001145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074001146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074001146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074001146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074001146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:02.939335 run osmo-stp_10.42.42.5(pid=23804): stdout: | (launched: 2022-12-14_07:40:00.959412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:03.064031 run osmo-stp_10.42.42.5(pid=23804): stderr: | 20221214074001145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074001145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074001145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074001146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074001146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074001146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074001146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:03.212082 run patchelf(pid=23810): Terminating (SIGINT) 07:40:03.385066 run patchelf(pid=23810): Terminated: ok {rc=0} 07:40:03.509809 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23804): Process ended prematurely: osmo-stp_10.42.42.5(pid=23804) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23804)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:40:03.519300 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 07:40:03.546477 run osmo-hlr_10.42.42.2(pid=23801): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23801)] 07:40:03.593860 run osmo-hlr_10.42.42.2(pid=23801): stdout: | (launched: 2022-12-14_07:39:59.987168) 07:40:03.643002 run osmo-hlr_10.42.42.2(pid=23801): stderr: | 20221214074000164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074000164 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074000164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074000164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074000164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074000164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074000176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074000184 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074000184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074000184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:03.692726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23794): Terminating (SIGTERM) 07:40:03.732521 run iperf3-srv_10.42.42.10(pid=23795): Terminating (SIGTERM) 07:40:03.772058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23796): Terminating (SIGTERM) 07:40:03.811754 run iperf3-srv_10.42.42.10(pid=23797): Terminating (SIGTERM) 07:40:03.851383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23800): Terminating (SIGTERM) 07:40:03.891016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23803): Terminating (SIGTERM) 07:40:03.930547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23809): Terminating (SIGTERM) 07:40:03.970396 --- ParallelTerminationStrategy: PID 23794 died... 07:40:03.989452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23794): Terminated: ok {rc=0} 07:40:04.033338 --- ParallelTerminationStrategy: PID 23795 died... 07:40:04.051660 run iperf3-srv_10.42.42.10(pid=23795): Terminated {rc=256} 07:40:04.095275 --- ParallelTerminationStrategy: PID 23796 died... 07:40:04.113795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23796): Terminated: ok {rc=0} 07:40:04.157318 --- ParallelTerminationStrategy: PID 23797 died... 07:40:04.175723 run iperf3-srv_10.42.42.10(pid=23797): Terminated {rc=256} 07:40:04.219266 --- ParallelTerminationStrategy: PID 23800 died... 07:40:04.237870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23800): Terminated: ok {rc=0} 07:40:04.281632 --- ParallelTerminationStrategy: PID 23803 died... 07:40:04.300110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23803): Terminated: ok {rc=0} 07:40:04.343785 --- ParallelTerminationStrategy: PID 23809 died... 07:40:04.362255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23809): Terminated: ok {rc=0} 07:40:04.446040 bus /gobi_0: Setting Powered False 07:40:05.544428 bus /gobi_0: Setting Powered False 07:40:06.661422 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:40:07.805163 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:07.816815 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:40:07.886898 tst iperf3.py: using LAC 39411 07:40:08.007745 tst iperf3.py: using RAC 141 07:40:08.129072 tst iperf3.py: using CellId 39411 07:40:08.249415 tst iperf3.py: using BVCI 39412 07:40:08.360568 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:08.371686 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:08.382588 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:08.393721 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:08.404409 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:08.415309 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:08.426245 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:08.437062 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:08.447887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:40:08.568874 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:40:08.790488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:40:09.119568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23811): Launched 07:40:09.405743 run iperf3-srv_10.42.42.10(pid=23812): Launched 07:40:09.535329 tst iperf3.py:8: start network... 07:40:09.756020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:10.262697 run create_hlr_db(pid=23813): Launched 07:40:10.389381 bus /gobi_6: Setting Powered False 07:40:11.454095 run create_hlr_db(pid=23813): Terminated: ok {rc=0} 07:40:11.908558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23815): Launched 07:40:12.238213 run osmo-hlr_10.42.42.2(pid=23816): Launched 07:40:12.363664 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:12.928912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23818): Launched 07:40:13.256509 run osmo-stp_10.42.42.5(pid=23819): Launched 07:40:13.382790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:40:13.947998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23821): Launched 07:40:14.074377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:40:14.351448 run patchelf(pid=23822): Launched 07:40:14.533692 run osmo-stp_10.42.42.5(pid=23819): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23819)] 07:40:14.671699 run osmo-stp_10.42.42.5(pid=23819): stdout: | (launched: 2022-12-14_07:40:13.195787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:14.812036 run osmo-stp_10.42.42.5(pid=23819): stderr: | 20221214074013389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074013389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074013390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074013390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074013390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074013390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074013390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:14.951902 run osmo-stp_10.42.42.5(pid=23819): stdout: | (launched: 2022-12-14_07:40:13.195787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:15.085272 run osmo-stp_10.42.42.5(pid=23819): stderr: | 20221214074013389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074013389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074013390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074013390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074013390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074013390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074013390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:15.243304 run patchelf(pid=23822): Terminating (SIGINT) 07:40:15.427853 run patchelf(pid=23822): Terminated: ok {rc=0} 07:40:15.561101 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23819): Process ended prematurely: osmo-stp_10.42.42.5(pid=23819) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23819)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 07:40:15.571374 tst iperf3.py:8: Test FAILED (7.8 sec) 07:40:15.599840 run osmo-hlr_10.42.42.2(pid=23816): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23816)] 07:40:15.650656 run osmo-hlr_10.42.42.2(pid=23816): stdout: | (launched: 2022-12-14_07:40:12.177572) 07:40:15.703754 run osmo-hlr_10.42.42.2(pid=23816): stderr: | 20221214074012376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074012376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074012376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074012376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074012376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074012376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074012393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074012401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074012401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074012401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:15.756645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23811): Terminating (SIGTERM) 07:40:15.798702 run iperf3-srv_10.42.42.10(pid=23812): Terminating (SIGTERM) 07:40:15.841482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23815): Terminating (SIGTERM) 07:40:15.884882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23818): Terminating (SIGTERM) 07:40:15.928827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23821): Terminating (SIGTERM) 07:40:15.972836 --- ParallelTerminationStrategy: PID 23811 died... 07:40:15.994083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23811): Terminated: ok {rc=0} 07:40:16.043519 --- ParallelTerminationStrategy: PID 23812 died... 07:40:16.064634 run iperf3-srv_10.42.42.10(pid=23812): Terminated {rc=256} 07:40:16.113146 --- ParallelTerminationStrategy: PID 23815 died... 07:40:16.134587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23815): Terminated: ok {rc=0} 07:40:16.182998 --- ParallelTerminationStrategy: PID 23818 died... 07:40:16.204500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23818): Terminated: ok {rc=0} 07:40:16.252907 --- ParallelTerminationStrategy: PID 23821 died... 07:40:16.274491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23821): Terminated: ok {rc=0} 07:40:16.369757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:40:17.521520 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:17.533788 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:40:17.606479 tst iperf3m4.py: using LAC 39412 07:40:17.735363 tst iperf3m4.py: using RAC 142 07:40:17.862835 tst iperf3m4.py: using CellId 39412 07:40:17.992576 tst iperf3m4.py: using BVCI 39413 07:40:18.113604 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:18.125075 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:18.136203 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:18.147535 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:18.159086 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:18.170726 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:18.182503 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:18.193990 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:18.205813 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:40:18.324759 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:40:18.449764 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:40:18.570567 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:40:18.690047 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:40:18.895453 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:40:19.203283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23823): Launched 07:40:19.473248 run iperf3-srv_10.42.42.10(pid=23824): Launched 07:40:19.588533 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:40:19.793288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:40:20.101727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23825): Launched 07:40:20.372283 run iperf3-srv_10.42.42.10(pid=23826): Launched 07:40:20.487050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:40:20.690613 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:40:21.000001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23827): Launched 07:40:21.268135 run iperf3-srv_10.42.42.10(pid=23828): Launched 07:40:21.383281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:40:21.587231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:40:21.895290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23829): Launched 07:40:22.164600 run iperf3-srv_10.42.42.10(pid=23830): Launched 07:40:22.281727 tst iperf3m4.py:8: start network... 07:40:22.485136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:22.959335 run create_hlr_db(pid=23831): Launched 07:40:23.087213 bus /gobi_6: Setting Powered False 07:40:24.148016 run create_hlr_db(pid=23831): Terminated: ok {rc=0} 07:40:24.595854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23833): Launched 07:40:24.925863 run osmo-hlr_10.42.42.2(pid=23834): Launched 07:40:25.053524 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:25.621561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23836): Launched 07:40:25.954656 run osmo-stp_10.42.42.5(pid=23837): Launched 07:40:26.081021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:40:26.646779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23839): Launched 07:40:26.774564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:40:27.051357 run patchelf(pid=23840): Launched 07:40:27.235537 run osmo-stp_10.42.42.5(pid=23837): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23837)] 07:40:27.374305 run osmo-stp_10.42.42.5(pid=23837): stdout: | (launched: 2022-12-14_07:40:25.893492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:27.514641 run osmo-stp_10.42.42.5(pid=23837): stderr: | 20221214074026087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074026087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074026087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074026087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074026088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074026088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074026088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:27.655056 run osmo-stp_10.42.42.5(pid=23837): stdout: | (launched: 2022-12-14_07:40:25.893492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:27.789881 run osmo-stp_10.42.42.5(pid=23837): stderr: | 20221214074026087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074026087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074026087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074026087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074026088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074026088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074026088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:27.948235 run patchelf(pid=23840): Terminating (SIGINT) 07:40:28.132894 run patchelf(pid=23840): Terminated: ok {rc=0} 07:40:28.266749 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23837): Process ended prematurely: osmo-stp_10.42.42.5(pid=23837) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23837)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:40:28.277096 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:40:28.306211 run osmo-hlr_10.42.42.2(pid=23834): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23834)] 07:40:28.357295 run osmo-hlr_10.42.42.2(pid=23834): stdout: | (launched: 2022-12-14_07:40:24.865064) 07:40:28.410133 run osmo-hlr_10.42.42.2(pid=23834): stderr: | 20221214074025063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074025063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074025063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074025063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074025063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074025064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074025076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074025086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074025086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074025086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:28.463305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23823): Terminating (SIGTERM) 07:40:28.505488 run iperf3-srv_10.42.42.10(pid=23824): Terminating (SIGTERM) 07:40:28.548292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23825): Terminating (SIGTERM) 07:40:28.591306 run iperf3-srv_10.42.42.10(pid=23826): Terminating (SIGTERM) 07:40:28.633918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23827): Terminating (SIGTERM) 07:40:28.676135 run iperf3-srv_10.42.42.10(pid=23828): Terminating (SIGTERM) 07:40:28.718643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23829): Terminating (SIGTERM) 07:40:28.761679 run iperf3-srv_10.42.42.10(pid=23830): Terminating (SIGTERM) 07:40:28.803965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23833): Terminating (SIGTERM) 07:40:28.846148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23836): Terminating (SIGTERM) 07:40:28.888034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23839): Terminating (SIGTERM) 07:40:28.930579 --- ParallelTerminationStrategy: PID 23823 died... 07:40:28.951149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23823): Terminated: ok {rc=0} 07:40:28.998324 --- ParallelTerminationStrategy: PID 23824 died... 07:40:29.018357 run iperf3-srv_10.42.42.10(pid=23824): Terminated {rc=256} 07:40:29.064771 --- ParallelTerminationStrategy: PID 23825 died... 07:40:29.084781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23825): Terminated: ok {rc=0} 07:40:29.132004 --- ParallelTerminationStrategy: PID 23826 died... 07:40:29.151995 run iperf3-srv_10.42.42.10(pid=23826): Terminated {rc=256} 07:40:29.198314 --- ParallelTerminationStrategy: PID 23827 died... 07:40:29.218033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23827): Terminated: ok {rc=0} 07:40:29.264713 --- ParallelTerminationStrategy: PID 23828 died... 07:40:29.284489 run iperf3-srv_10.42.42.10(pid=23828): Terminated {rc=256} 07:40:29.331515 --- ParallelTerminationStrategy: PID 23829 died... 07:40:29.351395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23829): Terminated: ok {rc=0} 07:40:29.397900 --- ParallelTerminationStrategy: PID 23830 died... 07:40:29.417841 run iperf3-srv_10.42.42.10(pid=23830): Terminated {rc=256} 07:40:29.463805 --- ParallelTerminationStrategy: PID 23833 died... 07:40:29.483779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23833): Terminated: ok {rc=0} 07:40:29.529887 --- ParallelTerminationStrategy: PID 23836 died... 07:40:29.549799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23836): Terminated: ok {rc=0} 07:40:29.596174 --- ParallelTerminationStrategy: PID 23839 died... 07:40:29.616197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23839): Terminated: ok {rc=0} 07:40:29.704429 bus /gobi_4: Setting Powered False 07:40:30.803914 bus /gobi_4: Setting Powered False 07:40:31.931830 bus /gobi_1: Setting Powered False 07:40:33.029151 bus /gobi_1: Setting Powered False 07:40:34.145236 bus /gobi_0: Setting Powered False 07:40:35.244539 bus /gobi_0: Setting Powered False 07:40:36.361585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:40:37.465943 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:37.478699 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:40:37.551418 tst ping.py: using LAC 39413 07:40:37.671372 tst ping.py: using RAC 143 07:40:37.790796 tst ping.py: using CellId 39413 07:40:37.910262 tst ping.py: using BVCI 39414 07:40:38.021510 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:38.032553 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:38.043394 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:38.054163 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:38.064866 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:38.075664 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:38.086529 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:38.097313 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:40:38.212267 tst ping.py:19: start network... 07:40:38.412097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:38.879336 run create_hlr_db(pid=23841): Launched 07:40:39.002752 bus /gobi_6: Setting Powered False 07:40:40.063048 run create_hlr_db(pid=23841): Terminated: ok {rc=0} 07:40:40.505127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23843): Launched 07:40:40.828808 run osmo-hlr_10.42.42.2(pid=23844): Launched 07:40:40.951276 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:41.508241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23846): Launched 07:40:41.832398 run osmo-stp_10.42.42.5(pid=23847): Launched 07:40:41.954929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:40:42.507806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23849): Launched 07:40:42.631918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:40:42.904048 run patchelf(pid=23850): Launched 07:40:43.084698 run osmo-stp_10.42.42.5(pid=23847): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23847)] 07:40:43.220761 run osmo-stp_10.42.42.5(pid=23847): stdout: | (launched: 2022-12-14_07:40:41.772399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:43.358097 run osmo-stp_10.42.42.5(pid=23847): stderr: | 20221214074041965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074041965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074041965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074041966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074041966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074041966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074041966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:43.495429 run osmo-stp_10.42.42.5(pid=23847): stdout: | (launched: 2022-12-14_07:40:41.772399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:43.626628 run osmo-stp_10.42.42.5(pid=23847): stderr: | 20221214074041965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074041965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074041965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074041966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074041966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074041966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074041966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:43.782421 run patchelf(pid=23850): Terminating (SIGINT) 07:40:43.963116 run patchelf(pid=23850): Terminated: ok {rc=0} 07:40:44.094037 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23847): Process ended prematurely: osmo-stp_10.42.42.5(pid=23847) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23847)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 07:40:44.103595 tst ping.py:22: Test FAILED (6.6 sec) 07:40:44.131958 run osmo-hlr_10.42.42.2(pid=23844): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23844)] 07:40:44.182791 run osmo-hlr_10.42.42.2(pid=23844): stdout: | (launched: 2022-12-14_07:40:40.768544) 07:40:44.235655 run osmo-hlr_10.42.42.2(pid=23844): stderr: | 20221214074040967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074040967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074040967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074040967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074040967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074040967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074040978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074040986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074040987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074040987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:44.288667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23843): Terminating (SIGTERM) 07:40:44.330941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23846): Terminating (SIGTERM) 07:40:44.373305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23849): Terminating (SIGTERM) 07:40:44.415969 --- ParallelTerminationStrategy: PID 23843 died... 07:40:44.436643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23843): Terminated: ok {rc=0} 07:40:44.483383 --- ParallelTerminationStrategy: PID 23846 died... 07:40:44.503439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23846): Terminated: ok {rc=0} 07:40:44.549856 --- ParallelTerminationStrategy: PID 23849 died... 07:40:44.569909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23849): Terminated: ok {rc=0} 07:40:44.658651 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:40:45.747362 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:45.759149 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:40:45.833634 tst ping_idle_ping.py: using LAC 39414 07:40:45.979392 tst ping_idle_ping.py: using RAC 144 07:40:46.107936 tst ping_idle_ping.py: using CellId 39414 07:40:46.230244 tst ping_idle_ping.py: using BVCI 39415 07:40:46.351038 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:46.363704 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:46.376266 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:46.388717 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:46.402245 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:46.415761 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:46.430407 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:40:46.444043 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:40:46.570136 tst ping_idle_ping.py:24: start network... 07:40:46.816814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:47.305967 run create_hlr_db(pid=23851): Launched 07:40:47.431091 bus /gobi_6: Setting Powered False 07:40:48.494466 run create_hlr_db(pid=23851): Terminated: ok {rc=0} 07:40:48.945154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23853): Launched 07:40:49.270759 run osmo-hlr_10.42.42.2(pid=23854): Launched 07:40:49.395631 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:49.957773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23856): Launched 07:40:50.262893 run osmo-stp_10.42.42.5(pid=23857): Launched 07:40:50.380435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:40:50.899956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23859): Launched 07:40:51.015523 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:40:51.272485 run patchelf(pid=23860): Launched 07:40:51.441657 run osmo-stp_10.42.42.5(pid=23857): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23857)] 07:40:51.569230 run osmo-stp_10.42.42.5(pid=23857): stdout: | (launched: 2022-12-14_07:40:50.206555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:51.698405 run osmo-stp_10.42.42.5(pid=23857): stderr: | 20221214074050378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074050378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074050378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074050378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074050379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074050379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074050379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:51.827798 run osmo-stp_10.42.42.5(pid=23857): stdout: | (launched: 2022-12-14_07:40:50.206555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:51.950770 run osmo-stp_10.42.42.5(pid=23857): stderr: | 20221214074050378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074050378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074050378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074050378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074050379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074050379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074050379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:52.097831 run patchelf(pid=23860): Terminating (SIGINT) 07:40:52.268524 run patchelf(pid=23860): Terminated: ok {rc=0} 07:40:52.391202 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23857): Process ended prematurely: osmo-stp_10.42.42.5(pid=23857) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23857)] [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:40:52.400085 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:40:52.426780 run osmo-hlr_10.42.42.2(pid=23854): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23854)] 07:40:52.474040 run osmo-hlr_10.42.42.2(pid=23854): stdout: | (launched: 2022-12-14_07:40:49.211031) 07:40:52.523208 run osmo-hlr_10.42.42.2(pid=23854): stderr: | 20221214074049409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074049409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074049409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074049409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074049409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074049409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074049424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074049432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074049432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074049432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:52.572726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23853): Terminating (SIGTERM) 07:40:52.612744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23856): Terminating (SIGTERM) 07:40:52.652536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23859): Terminating (SIGTERM) 07:40:52.692433 --- ParallelTerminationStrategy: PID 23853 died... 07:40:52.711376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23853): Terminated: ok {rc=0} 07:40:52.755341 --- ParallelTerminationStrategy: PID 23856 died... 07:40:52.773690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23856): Terminated: ok {rc=0} 07:40:52.817641 --- ParallelTerminationStrategy: PID 23859 died... 07:40:52.836253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23859): Terminated: ok {rc=0} 07:40:52.921526 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:40:54.223907 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:54.231180 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:40:54.263766 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 07:40:54.302727 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 07:40:54.389146 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:40:54.421201 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 07:40:54.459101 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 07:40:55.064687 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 07:40:55.114423 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:40:55.126037 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:40:55.178157 tst cs_paging_gprs_active.py: using LAC 39415 07:40:55.300371 tst cs_paging_gprs_active.py: using RAC 145 07:40:55.431058 tst cs_paging_gprs_active.py: using CellId 39415 07:40:55.560940 tst cs_paging_gprs_active.py: using BVCI 39416 07:40:55.674456 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:40:55.685840 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:40:55.696906 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:40:55.708028 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:40:55.719160 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:40:55.730208 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:40:55.741348 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:40:55.752259 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:40:55.763568 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:40:55.886461 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:40:56.008758 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:40:56.230823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:40:56.561200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23867): Launched 07:40:56.849804 run iperf3-srv_10.42.42.10(pid=23868): Launched 07:40:56.974304 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:40:57.197693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:40:57.530495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23869): Launched 07:40:57.819462 run iperf3-srv_10.42.42.10(pid=23870): Launched 07:40:57.944468 tst cs_paging_gprs_active.py:38: start network... 07:40:58.165466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:58.674962 run create_hlr_db(pid=23871): Launched 07:40:58.803393 bus /gobi_6: Setting Powered False 07:40:59.868387 run create_hlr_db(pid=23871): Terminated: ok {rc=0} 07:41:00.326225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23873): Launched 07:41:00.657650 run osmo-hlr_10.42.42.2(pid=23874): Launched 07:41:00.786578 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:01.421508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23876): Launched 07:41:01.765147 run osmo-stp_10.42.42.5(pid=23877): Launched 07:41:02.014805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:41:02.656349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23879): Launched 07:41:02.784434 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:41:03.062833 run patchelf(pid=23880): Launched 07:41:03.245754 run osmo-stp_10.42.42.5(pid=23877): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23877)] 07:41:03.384601 run osmo-stp_10.42.42.5(pid=23877): stdout: | (launched: 2022-12-14_07:41:01.704018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:03.524413 run osmo-stp_10.42.42.5(pid=23877): stderr: | 20221214074102002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074102002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074102002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074102002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074102003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074102003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074102003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:03.664137 run osmo-stp_10.42.42.5(pid=23877): stdout: | (launched: 2022-12-14_07:41:01.704018) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:03.799185 run osmo-stp_10.42.42.5(pid=23877): stderr: | 20221214074102002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074102002 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074102002 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074102002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074102003 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074102003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074102003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:03.958170 run patchelf(pid=23880): Terminating (SIGINT) 07:41:04.143028 run patchelf(pid=23880): Terminated: ok {rc=0} 07:41:04.276414 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23877): Process ended prematurely: osmo-stp_10.42.42.5(pid=23877) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23877)] [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 07:41:04.286818 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 07:41:04.315467 run osmo-hlr_10.42.42.2(pid=23874): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23874)] 07:41:04.366573 run osmo-hlr_10.42.42.2(pid=23874): stdout: | (launched: 2022-12-14_07:41:00.596539) 07:41:04.419208 run osmo-hlr_10.42.42.2(pid=23874): stderr: | 20221214074100797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074100797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074100797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074100797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074100797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074100797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074100810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074100818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074100818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074100818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:04.472230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23867): Terminating (SIGTERM) 07:41:04.514540 run iperf3-srv_10.42.42.10(pid=23868): Terminating (SIGTERM) 07:41:04.556714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23869): Terminating (SIGTERM) 07:41:04.598912 run iperf3-srv_10.42.42.10(pid=23870): Terminating (SIGTERM) 07:41:04.641028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23873): Terminating (SIGTERM) 07:41:04.683265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23876): Terminating (SIGTERM) 07:41:04.725858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23879): Terminating (SIGTERM) 07:41:04.768388 --- ParallelTerminationStrategy: PID 23867 died... 07:41:04.788646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23867): Terminated: ok {rc=0} 07:41:04.835641 --- ParallelTerminationStrategy: PID 23868 died... 07:41:04.855354 run iperf3-srv_10.42.42.10(pid=23868): Terminated {rc=256} 07:41:04.901869 --- ParallelTerminationStrategy: PID 23869 died... 07:41:04.921725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23869): Terminated: ok {rc=0} 07:41:04.968122 --- ParallelTerminationStrategy: PID 23870 died... 07:41:04.987875 run iperf3-srv_10.42.42.10(pid=23870): Terminated {rc=256} 07:41:05.034294 --- ParallelTerminationStrategy: PID 23873 died... 07:41:05.054032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23873): Terminated: ok {rc=0} 07:41:05.100306 --- ParallelTerminationStrategy: PID 23876 died... 07:41:05.120541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23876): Terminated: ok {rc=0} 07:41:05.167104 --- ParallelTerminationStrategy: PID 23879 died... 07:41:05.186967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23879): Terminated: ok {rc=0} 07:41:05.275743 bus /gobi_0: Setting Powered False 07:41:06.375252 bus /gobi_0: Setting Powered False 07:41:07.490744 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 07:41:08.642126 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:08.654670 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:41:08.714309 tst iperf3.py: using LAC 39416 07:41:08.832923 tst iperf3.py: using RAC 146 07:41:08.951621 tst iperf3.py: using CellId 39416 07:41:09.070161 tst iperf3.py: using BVCI 39417 07:41:09.182198 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:09.193649 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:09.204836 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:09.215912 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:09.226964 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:09.238116 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:09.249236 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:09.260539 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:09.271931 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:41:09.389418 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:41:09.594270 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:41:09.904292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23881): Launched 07:41:10.173518 run iperf3-srv_10.42.42.10(pid=23882): Launched 07:41:10.289605 tst iperf3.py:8: start network... 07:41:10.496768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:10.975195 run create_hlr_db(pid=23883): Launched 07:41:11.101785 bus /gobi_6: Setting Powered False 07:41:12.162166 run create_hlr_db(pid=23883): Terminated: ok {rc=0} 07:41:12.590383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23885): Launched 07:41:12.898200 run osmo-hlr_10.42.42.2(pid=23886): Launched 07:41:13.014201 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:13.540635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23888): Launched 07:41:13.848456 run osmo-stp_10.42.42.5(pid=23889): Launched 07:41:13.965400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:41:14.492718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23891): Launched 07:41:14.610403 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:41:14.870655 run patchelf(pid=23892): Launched 07:41:15.041452 run osmo-stp_10.42.42.5(pid=23889): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23889)] 07:41:15.170747 run osmo-stp_10.42.42.5(pid=23889): stdout: | (launched: 2022-12-14_07:41:13.791204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:15.301775 run osmo-stp_10.42.42.5(pid=23889): stderr: | 20221214074113964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074113964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074113965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074113965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074113966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074113966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074113966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:15.433663 run osmo-stp_10.42.42.5(pid=23889): stdout: | (launched: 2022-12-14_07:41:13.791204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:15.558789 run osmo-stp_10.42.42.5(pid=23889): stderr: | 20221214074113964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074113964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074113965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074113965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074113966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074113966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074113966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:15.706758 run patchelf(pid=23892): Terminating (SIGINT) 07:41:15.901439 run patchelf(pid=23892): Terminated: ok {rc=0} 07:41:16.040024 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23889): Process ended prematurely: osmo-stp_10.42.42.5(pid=23889) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23889)] [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 07:41:16.051522 tst iperf3.py:8: Test FAILED (7.4 sec) 07:41:16.081755 run osmo-hlr_10.42.42.2(pid=23886): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23886)] 07:41:16.137400 run osmo-hlr_10.42.42.2(pid=23886): stdout: | (launched: 2022-12-14_07:41:12.840854) 07:41:16.191756 run osmo-hlr_10.42.42.2(pid=23886): stderr: | 20221214074113018 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074113018 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074113018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074113018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074113018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074113018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074113030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074113039 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074113039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074113039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:16.247248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23881): Terminating (SIGTERM) 07:41:16.291467 run iperf3-srv_10.42.42.10(pid=23882): Terminating (SIGTERM) 07:41:16.340928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23885): Terminating (SIGTERM) 07:41:16.386386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23888): Terminating (SIGTERM) 07:41:16.433520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23891): Terminating (SIGTERM) 07:41:16.485496 --- ParallelTerminationStrategy: PID 23881 died... 07:41:16.508799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23881): Terminated: ok {rc=0} 07:41:16.562670 --- ParallelTerminationStrategy: PID 23882 died... 07:41:16.586352 run iperf3-srv_10.42.42.10(pid=23882): Terminated {rc=256} 07:41:16.638504 --- ParallelTerminationStrategy: PID 23885 died... 07:41:16.661667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23885): Terminated: ok {rc=0} 07:41:16.715731 --- ParallelTerminationStrategy: PID 23888 died... 07:41:16.739498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23888): Terminated: ok {rc=0} 07:41:16.794256 --- ParallelTerminationStrategy: PID 23891 died... 07:41:16.817829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23891): Terminated: ok {rc=0} 07:41:16.919707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 07:41:18.085489 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:18.097756 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:41:18.150853 tst iperf3m4.py: using LAC 39417 07:41:18.271710 tst iperf3m4.py: using RAC 147 07:41:18.392726 tst iperf3m4.py: using CellId 39417 07:41:18.515966 tst iperf3m4.py: using BVCI 39418 07:41:18.628637 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:18.640201 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:18.651481 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:18.662891 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:18.674275 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:18.685640 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:18.696799 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:18.708164 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:18.719677 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:41:18.842065 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:41:18.963428 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:41:19.086285 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:41:19.206176 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:41:19.412937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:41:19.722287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23893): Launched 07:41:19.991346 run iperf3-srv_10.42.42.10(pid=23894): Launched 07:41:20.108392 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:41:20.313479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:41:20.622037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23895): Launched 07:41:20.892839 run iperf3-srv_10.42.42.10(pid=23896): Launched 07:41:21.009552 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:41:21.214264 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:41:21.523278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23897): Launched 07:41:21.794481 run iperf3-srv_10.42.42.10(pid=23898): Launched 07:41:21.911483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:41:22.116354 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:41:22.425224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23899): Launched 07:41:22.695125 run iperf3-srv_10.42.42.10(pid=23900): Launched 07:41:22.811636 tst iperf3m4.py:8: start network... 07:41:23.016369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:23.492644 run create_hlr_db(pid=23901): Launched 07:41:23.618383 bus /gobi_6: Setting Powered False 07:41:24.679333 run create_hlr_db(pid=23901): Terminated: ok {rc=0} 07:41:25.108621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23903): Launched 07:41:25.417728 run osmo-hlr_10.42.42.2(pid=23904): Launched 07:41:25.536273 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:26.071681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23906): Launched 07:41:26.380132 run osmo-stp_10.42.42.5(pid=23907): Launched 07:41:26.498805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:41:27.026800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23909): Launched 07:41:27.145889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:41:27.405002 run patchelf(pid=23910): Launched 07:41:27.576569 run osmo-stp_10.42.42.5(pid=23907): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23907)] 07:41:27.705874 run osmo-stp_10.42.42.5(pid=23907): stdout: | (launched: 2022-12-14_07:41:26.322981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:27.837146 run osmo-stp_10.42.42.5(pid=23907): stderr: | 20221214074126493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074126493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074126493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074126494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074126494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074126494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074126494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:27.968327 run osmo-stp_10.42.42.5(pid=23907): stdout: | (launched: 2022-12-14_07:41:26.322981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:28.092883 run osmo-stp_10.42.42.5(pid=23907): stderr: | 20221214074126493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074126493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074126493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074126494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074126494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074126494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074126494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:28.240839 run patchelf(pid=23910): Terminating (SIGINT) 07:41:28.414034 run patchelf(pid=23910): Terminated: ok {rc=0} 07:41:28.539181 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23907): Process ended prematurely: osmo-stp_10.42.42.5(pid=23907) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23907)] [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 07:41:28.548829 tst iperf3m4.py:8: Test FAILED (10.5 sec) 07:41:28.576517 run osmo-hlr_10.42.42.2(pid=23904): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23904)] 07:41:28.624239 run osmo-hlr_10.42.42.2(pid=23904): stdout: | (launched: 2022-12-14_07:41:25.359470) 07:41:28.673334 run osmo-hlr_10.42.42.2(pid=23904): stderr: | 20221214074125538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074125538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074125538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074125538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074125538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074125538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074125551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074125562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074125562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074125562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:28.722745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23893): Terminating (SIGTERM) 07:41:28.762584 run iperf3-srv_10.42.42.10(pid=23894): Terminating (SIGTERM) 07:41:28.802192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23895): Terminating (SIGTERM) 07:41:28.841920 run iperf3-srv_10.42.42.10(pid=23896): Terminating (SIGTERM) 07:41:28.881494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23897): Terminating (SIGTERM) 07:41:28.921140 run iperf3-srv_10.42.42.10(pid=23898): Terminating (SIGTERM) 07:41:28.960604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23899): Terminating (SIGTERM) 07:41:29.000239 run iperf3-srv_10.42.42.10(pid=23900): Terminating (SIGTERM) 07:41:29.039584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23903): Terminating (SIGTERM) 07:41:29.079227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23906): Terminating (SIGTERM) 07:41:29.118885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23909): Terminating (SIGTERM) 07:41:29.158685 --- ParallelTerminationStrategy: PID 23893 died... 07:41:29.177794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23893): Terminated: ok {rc=0} 07:41:29.221726 --- ParallelTerminationStrategy: PID 23894 died... 07:41:29.240244 run iperf3-srv_10.42.42.10(pid=23894): Terminated {rc=256} 07:41:29.283839 --- ParallelTerminationStrategy: PID 23895 died... 07:41:29.302415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23895): Terminated: ok {rc=0} 07:41:29.346035 --- ParallelTerminationStrategy: PID 23896 died... 07:41:29.364426 run iperf3-srv_10.42.42.10(pid=23896): Terminated {rc=256} 07:41:29.408527 --- ParallelTerminationStrategy: PID 23897 died... 07:41:29.427545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23897): Terminated: ok {rc=0} 07:41:29.471260 --- ParallelTerminationStrategy: PID 23898 died... 07:41:29.489820 run iperf3-srv_10.42.42.10(pid=23898): Terminated {rc=256} 07:41:29.533363 --- ParallelTerminationStrategy: PID 23899 died... 07:41:29.552033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23899): Terminated: ok {rc=0} 07:41:29.595692 --- ParallelTerminationStrategy: PID 23900 died... 07:41:29.614229 run iperf3-srv_10.42.42.10(pid=23900): Terminated {rc=256} 07:41:29.657827 --- ParallelTerminationStrategy: PID 23903 died... 07:41:29.676578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23903): Terminated: ok {rc=0} 07:41:29.720194 --- ParallelTerminationStrategy: PID 23906 died... 07:41:29.738918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23906): Terminated: ok {rc=0} 07:41:29.782571 --- ParallelTerminationStrategy: PID 23909 died... 07:41:29.801376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23909): Terminated: ok {rc=0} 07:41:29.887347 bus /gobi_4: Setting Powered False 07:41:31.002855 bus /gobi_4: Setting Powered False 07:41:32.129856 bus /gobi_1: Setting Powered False 07:41:33.239217 bus /gobi_1: Setting Powered False 07:41:34.355388 bus /gobi_0: Setting Powered False 07:41:35.454565 bus /gobi_0: Setting Powered False 07:41:36.571960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 07:41:37.676021 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:37.688314 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:41:37.740837 tst ping.py: using LAC 39418 07:41:37.860566 tst ping.py: using RAC 148 07:41:37.984337 tst ping.py: using CellId 39418 07:41:38.109845 tst ping.py: using BVCI 39419 07:41:38.227141 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:38.239257 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:38.251600 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:38.263406 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:38.275655 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:38.287809 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:38.300021 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:38.312119 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:41:38.429708 tst ping.py:19: start network... 07:41:38.632230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:39.096866 run create_hlr_db(pid=23911): Launched 07:41:39.222164 bus /gobi_6: Setting Powered False 07:41:40.282361 run create_hlr_db(pid=23911): Terminated: ok {rc=0} 07:41:40.703564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23913): Launched 07:41:41.005512 run osmo-hlr_10.42.42.2(pid=23914): Launched 07:41:41.120328 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:41.644386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23916): Launched 07:41:41.946250 run osmo-stp_10.42.42.5(pid=23917): Launched 07:41:42.062396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:41:42.581983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23919): Launched 07:41:42.697204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:41:42.952808 run patchelf(pid=23920): Launched 07:41:43.122527 run osmo-stp_10.42.42.5(pid=23917): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23917)] 07:41:43.249920 run osmo-stp_10.42.42.5(pid=23917): stdout: | (launched: 2022-12-14_07:41:41.889802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:43.379004 run osmo-stp_10.42.42.5(pid=23917): stderr: | 20221214074142061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074142061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074142062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074142062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074142063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074142063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074142063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:43.508240 run osmo-stp_10.42.42.5(pid=23917): stdout: | (launched: 2022-12-14_07:41:41.889802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:43.632331 run osmo-stp_10.42.42.5(pid=23917): stderr: | 20221214074142061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074142061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074142062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074142062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074142063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074142063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074142063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:43.777807 run patchelf(pid=23920): Terminating (SIGINT) 07:41:43.948199 run patchelf(pid=23920): Terminated: ok {rc=0} 07:41:44.071476 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23917): Process ended prematurely: osmo-stp_10.42.42.5(pid=23917) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23917)] [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 07:41:44.080540 tst ping.py:22: Test FAILED (6.4 sec) 07:41:44.107479 run osmo-hlr_10.42.42.2(pid=23914): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23914)] 07:41:44.154666 run osmo-hlr_10.42.42.2(pid=23914): stdout: | (launched: 2022-12-14_07:41:40.948926) 07:41:44.203680 run osmo-hlr_10.42.42.2(pid=23914): stderr: | 20221214074141125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074141125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074141125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074141125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074141125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074141125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074141137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074141146 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074141147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074141147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:44.253226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23913): Terminating (SIGTERM) 07:41:44.292778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23916): Terminating (SIGTERM) 07:41:44.332474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23919): Terminating (SIGTERM) 07:41:44.372168 --- ParallelTerminationStrategy: PID 23913 died... 07:41:44.391144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23913): Terminated: ok {rc=0} 07:41:44.434805 --- ParallelTerminationStrategy: PID 23916 died... 07:41:44.453487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23916): Terminated: ok {rc=0} 07:41:44.497166 --- ParallelTerminationStrategy: PID 23919 died... 07:41:44.515734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23919): Terminated: ok {rc=0} 07:41:44.599434 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 07:41:45.686231 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:45.699066 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:41:45.755721 tst ping_idle_ping.py: using LAC 39419 07:41:45.891140 tst ping_idle_ping.py: using RAC 149 07:41:46.034396 tst ping_idle_ping.py: using CellId 39419 07:41:46.155769 tst ping_idle_ping.py: using BVCI 39420 07:41:46.267019 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:46.279529 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:46.291782 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:46.305223 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:46.317733 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:46.330563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:46.342699 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:41:46.355044 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:41:46.477738 tst ping_idle_ping.py:24: start network... 07:41:46.757202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:47.288152 run create_hlr_db(pid=23922): Launched 07:41:47.418771 bus /gobi_6: Setting Powered False 07:41:48.483013 run create_hlr_db(pid=23922): Terminated: ok {rc=0} 07:41:48.934829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23924): Launched 07:41:49.259425 run osmo-hlr_10.42.42.2(pid=23925): Launched 07:41:49.384648 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:49.946917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23927): Launched 07:41:50.255477 run osmo-stp_10.42.42.5(pid=23928): Launched 07:41:50.374034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:41:50.895931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23930): Launched 07:41:51.013314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:41:51.269162 run patchelf(pid=23931): Launched 07:41:51.437332 run osmo-stp_10.42.42.5(pid=23928): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23928)] 07:41:51.565410 run osmo-stp_10.42.42.5(pid=23928): stdout: | (launched: 2022-12-14_07:41:50.198681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:51.695860 run osmo-stp_10.42.42.5(pid=23928): stderr: | 20221214074150370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074150370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074150370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074150371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074150371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074150371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074150371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:51.826031 run osmo-stp_10.42.42.5(pid=23928): stdout: | (launched: 2022-12-14_07:41:50.198681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:51.949207 run osmo-stp_10.42.42.5(pid=23928): stderr: | 20221214074150370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074150370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074150370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074150371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074150371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074150371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074150371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:52.095548 run patchelf(pid=23931): Terminating (SIGINT) 07:41:52.266534 run patchelf(pid=23931): Terminated: ok {rc=0} 07:41:52.389567 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23928): Process ended prematurely: osmo-stp_10.42.42.5(pid=23928) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23928)] [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 07:41:52.398494 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:41:52.425097 run osmo-hlr_10.42.42.2(pid=23925): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23925)] 07:41:52.472925 run osmo-hlr_10.42.42.2(pid=23925): stdout: | (launched: 2022-12-14_07:41:49.199624) 07:41:52.521911 run osmo-hlr_10.42.42.2(pid=23925): stderr: | 20221214074149397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074149397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074149397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074149397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074149398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074149398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074149410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074149418 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074149419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074149419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:52.571390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23924): Terminating (SIGTERM) 07:41:52.611295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23927): Terminating (SIGTERM) 07:41:52.651199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23930): Terminating (SIGTERM) 07:41:52.691399 --- ParallelTerminationStrategy: PID 23924 died... 07:41:52.710708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23924): Terminated: ok {rc=0} 07:41:52.754914 --- ParallelTerminationStrategy: PID 23927 died... 07:41:52.773838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23927): Terminated: ok {rc=0} 07:41:52.817718 --- ParallelTerminationStrategy: PID 23930 died... 07:41:52.836606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23930): Terminated: ok {rc=0} 07:41:52.922971 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:41:54.239421 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:41:54.247128 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:41:54.281288 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:41:54.316895 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:41:54.371921 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:41:54.404559 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:41:54.439285 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:41:55.002346 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:41:55.007587 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:41:55.019062 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:41:55.088366 tst switch_tch_pdch.py: using LAC 39420 07:41:55.216833 tst switch_tch_pdch.py: using RAC 150 07:41:55.342847 tst switch_tch_pdch.py: using CellId 39420 07:41:55.470642 tst switch_tch_pdch.py: using BVCI 39421 07:41:55.587820 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:41:55.599726 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:41:55.611436 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:41:55.623278 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:41:55.635089 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:41:55.647236 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:41:55.659854 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:41:55.672329 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:41:55.792391 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:41:55.911077 tst switch_tch_pdch.py:51: start network... 07:41:56.112871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:56.578368 run create_hlr_db(pid=23935): Launched 07:41:56.703431 bus /gobi_6: Setting Powered False 07:41:57.763634 run create_hlr_db(pid=23935): Terminated: ok {rc=0} 07:41:58.184843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23937): Launched 07:41:58.486257 run osmo-hlr_10.42.42.2(pid=23938): Launched 07:41:58.600607 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:59.116681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23940): Launched 07:41:59.417907 run osmo-stp_10.42.42.5(pid=23941): Launched 07:41:59.531858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:42:00.051164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23943): Launched 07:42:00.167574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:42:00.422140 run patchelf(pid=23944): Launched 07:42:00.590586 run osmo-stp_10.42.42.5(pid=23941): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23941)] 07:42:00.717702 run osmo-stp_10.42.42.5(pid=23941): stdout: | (launched: 2022-12-14_07:41:59.361774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:00.869819 run osmo-stp_10.42.42.5(pid=23941): stderr: | 20221214074159532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074159532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074159532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074159533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074159533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074159534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074159534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:01.062515 run osmo-stp_10.42.42.5(pid=23941): stdout: | (launched: 2022-12-14_07:41:59.361774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:01.263824 run osmo-stp_10.42.42.5(pid=23941): stderr: | 20221214074159532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074159532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074159532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074159533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074159533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074159534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074159534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:01.426737 run patchelf(pid=23944): Terminating (SIGINT) 07:42:01.614694 run patchelf(pid=23944): Terminated: ok {rc=0} 07:42:01.753898 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23941): Process ended prematurely: osmo-stp_10.42.42.5(pid=23941) [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23941)] [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:42:01.764792 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:42:01.794637 run osmo-hlr_10.42.42.2(pid=23938): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23938)] 07:42:01.850010 run osmo-hlr_10.42.42.2(pid=23938): stdout: | (launched: 2022-12-14_07:41:58.429673) 07:42:01.906425 run osmo-hlr_10.42.42.2(pid=23938): stderr: | 20221214074158606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074158606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074158607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074158607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074158607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074158607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074158619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074158627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074158627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074158627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:01.962076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23937): Terminating (SIGTERM) 07:42:02.007219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23940): Terminating (SIGTERM) 07:42:02.054484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23943): Terminating (SIGTERM) 07:42:02.102471 --- ParallelTerminationStrategy: PID 23937 died... 07:42:02.124457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23937): Terminated: ok {rc=0} 07:42:02.175861 --- ParallelTerminationStrategy: PID 23940 died... 07:42:02.196322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23940): Terminated: ok {rc=0} 07:42:02.244869 --- ParallelTerminationStrategy: PID 23943 died... 07:42:02.267273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23943): Terminated: ok {rc=0} 07:42:02.359967 bus /gobi_0: Setting Powered False 07:42:03.459108 bus /gobi_0: Setting Powered False 07:42:04.574784 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:42:05.830322 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:05.836063 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:42:05.868034 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:42:05.902486 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:42:05.960257 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:42:05.992792 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:42:06.027166 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:42:06.580530 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:42:06.587001 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:42:06.599002 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:42:06.672212 tst switch_tch_pdch.py: using LAC 39421 07:42:06.798219 tst switch_tch_pdch.py: using RAC 151 07:42:06.924083 tst switch_tch_pdch.py: using CellId 39421 07:42:07.049637 tst switch_tch_pdch.py: using BVCI 39422 07:42:07.161650 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:42:07.172829 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:42:07.183870 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:42:07.195002 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:42:07.206481 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:42:07.218223 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:42:07.230033 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:42:07.241631 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:42:07.363588 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:42:07.482062 tst switch_tch_pdch.py:51: start network... 07:42:07.683769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:08.124486 run create_hlr_db(pid=23958): Launched 07:42:08.248497 bus /gobi_6: Setting Powered False 07:42:09.308605 run create_hlr_db(pid=23958): Terminated: ok {rc=0} 07:42:09.719877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23960): Launched 07:42:10.043964 run osmo-hlr_10.42.42.2(pid=23961): Launched 07:42:10.168863 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:10.693619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23963): Launched 07:42:11.018814 run osmo-stp_10.42.42.5(pid=23964): Launched 07:42:11.143645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:42:11.670211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23966): Launched 07:42:11.794229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:42:12.066100 run patchelf(pid=23967): Launched 07:42:12.244594 run osmo-stp_10.42.42.5(pid=23964): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23964)] 07:42:12.380157 run osmo-stp_10.42.42.5(pid=23964): stdout: | (launched: 2022-12-14_07:42:10.958947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:12.517845 run osmo-stp_10.42.42.5(pid=23964): stderr: | 20221214074211150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074211150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074211150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074211150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074211151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074211151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074211151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:12.655212 run osmo-stp_10.42.42.5(pid=23964): stdout: | (launched: 2022-12-14_07:42:10.958947) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:12.786490 run osmo-stp_10.42.42.5(pid=23964): stderr: | 20221214074211150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074211150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074211150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074211150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074211151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074211151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074211151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:12.941715 run patchelf(pid=23967): Terminating (SIGINT) 07:42:13.122389 run patchelf(pid=23967): Terminated: ok {rc=0} 07:42:13.252612 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=23964): Process ended prematurely: osmo-stp_10.42.42.5(pid=23964) [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23964)] [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:42:13.262352 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:42:13.290182 run osmo-hlr_10.42.42.2(pid=23961): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23961)] 07:42:13.340523 run osmo-hlr_10.42.42.2(pid=23961): stdout: | (launched: 2022-12-14_07:42:09.984447) 07:42:13.392820 run osmo-hlr_10.42.42.2(pid=23961): stderr: | 20221214074210182 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074210182 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074210182 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074210182 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074210182 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074210182 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074210212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074210221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074210221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074210221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:13.445664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23960): Terminating (SIGTERM) 07:42:13.487502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23963): Terminating (SIGTERM) 07:42:13.529727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23966): Terminating (SIGTERM) 07:42:13.572047 --- ParallelTerminationStrategy: PID 23960 died... 07:42:13.592275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23960): Terminated: ok {rc=0} 07:42:13.638535 --- ParallelTerminationStrategy: PID 23963 died... 07:42:13.658396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23963): Terminated: ok {rc=0} 07:42:13.704262 --- ParallelTerminationStrategy: PID 23966 died... 07:42:13.724158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23966): Terminated: ok {rc=0} 07:42:13.813594 bus /gobi_0: Setting Powered False 07:42:14.911234 bus /gobi_0: Setting Powered False 07:42:16.055074 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_sms:trx-lms --------------------------------------------------------------------- 07:42:17.323034 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:17.327767 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 07:42:17.360811 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 07:42:17.367760 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 07:42:17.421422 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 07:42:17.454884 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 07:42:17.461735 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 07:42:17.999615 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 07:42:18.005427 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 07:42:18.016641 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 07:42:18.066638 tst mo_mt_sms.py: using LAC 39422 07:42:18.191988 tst mo_mt_sms.py: using RAC 152 07:42:18.317403 tst mo_mt_sms.py: using CellId 39422 07:42:18.443932 tst mo_mt_sms.py: using BVCI 39423 07:42:18.560408 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 07:42:18.676813 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 07:42:18.796681 tst mo_mt_sms.py:9: start nitb and bts... 07:42:19.014345 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:42:19.667634 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23971): Launched 07:42:19.992522 run osmo-nitb_10.42.42.2(pid=23972): Launched 07:42:20.170520 run osmo-nitb_10.42.42.2(pid=23972): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23972)] 07:42:20.314557 run osmo-nitb_10.42.42.2(pid=23972): stdout: | (launched: 2022-12-14_07:42:19.932768) 07:42:20.460775 run osmo-nitb_10.42.42.2(pid=23972): stderr: | (launched: 2022-12-14_07:42:19.980638) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:42:20.606325 run osmo-nitb_10.42.42.2(pid=23972): stdout: | (launched: 2022-12-14_07:42:19.932768) 07:42:20.746061 run osmo-nitb_10.42.42.2(pid=23972): stderr: | (launched: 2022-12-14_07:42:19.980638) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23972): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23972) [trial-2401↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23972)] 07:42:21.113663 tst osmo-nitb_10.42.42.2(pid=23972): stdout: | (launched: 2022-12-14_07:42:19.932768) 07:42:21.243817 tst osmo-nitb_10.42.42.2(pid=23972): stderr: | (launched: 2022-12-14_07:42:19.980638) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:42:21.397683 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23972): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23972) [trial-2401↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23972)] [trial-2401↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 07:42:21.406905 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:42:21.414361 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23971): Terminating (SIGTERM) 07:42:21.625619 --- ParallelTerminationStrategy: PID 23971 died... 07:42:21.647630 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23971): Terminated: ok {rc=0} 07:42:21.736516 bus /sierra_3: Setting Powered False 07:42:22.836868 bus /sierra_3: Setting Powered False 07:42:23.955327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 sms:trx-lms --------------------------------------------------------------------- 07:42:25.152202 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:25.156557 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 07:42:25.189228 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 07:42:25.215856 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 07:42:25.267937 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 07:42:25.301708 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 07:42:25.329477 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 07:42:25.871717 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 07:42:25.876917 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:25.887886 tst sms:trx-lms: Using 1 x bts (candidates: 1) 07:42:25.935570 tst mo_mt_sms.py: using LAC 39423 07:42:26.054865 tst mo_mt_sms.py: using RAC 153 07:42:26.173559 tst mo_mt_sms.py: using CellId 39423 07:42:26.294679 tst mo_mt_sms.py: using BVCI 39424 07:42:26.404348 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:26.414947 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:26.425489 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:26.435802 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:26.446211 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:26.456647 tst sms:trx-lms: Using 1 x modem (candidates: 2) 07:42:26.575841 tst sms:trx-lms: Using 1 x modem (candidates: 2) 07:42:26.696445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:27.160016 run create_hlr_db(pid=23976): Launched 07:42:27.282151 bus /sierra_2: Setting Powered False 07:42:28.341901 run create_hlr_db(pid=23976): Terminated: ok {rc=0} 07:42:28.781694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23978): Launched 07:42:29.102861 run osmo-hlr_10.42.42.2(pid=23979): Launched 07:42:29.226705 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:29.784553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23981): Launched 07:42:30.105916 run osmo-stp_10.42.42.5(pid=23982): Launched 07:42:30.229799 run osmo-msc_10.42.42.6: Starting osmo-msc 07:42:30.812699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23984): Launched 07:42:31.156742 run osmo-msc_10.42.42.6(pid=23985): Launched 07:42:31.626503 run osmo-stp_10.42.42.5(pid=23982): ERR: Terminated: ERROR {rc=1} [trial-2401↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23982)] 07:42:31.837301 run osmo-stp_10.42.42.5(pid=23982): stdout: | (launched: 2022-12-14_07:42:30.046398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:32.005951 run osmo-stp_10.42.42.5(pid=23982): stderr: | 20221214074230239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074230239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074230239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074230240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074230240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074230240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074230240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:32.173468 run osmo-stp_10.42.42.5(pid=23982): stdout: | (launched: 2022-12-14_07:42:30.046398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:32.330059 run osmo-stp_10.42.42.5(pid=23982): stderr: | 20221214074230239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074230239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074230239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074230240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074230240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074230240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074230240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:32.489839 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23982): Process ended prematurely: osmo-stp_10.42.42.5(pid=23982) [trial-2401↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23982)] [trial-2401↪sms:trx-lms↪mo_mt_sms.py:16] 07:42:32.499033 tst mo_mt_sms.py:16: Test FAILED (6.6 sec) 07:42:32.526610 run osmo-hlr_10.42.42.2(pid=23979): ERR: Terminated: ERROR {rc=237} [trial-2401↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23979)] 07:42:32.578610 run osmo-hlr_10.42.42.2(pid=23979): stdout: | (launched: 2022-12-14_07:42:29.043317) 07:42:32.631836 run osmo-hlr_10.42.42.2(pid=23979): stderr: | 20221214074229242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074229242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074229242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074229242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074229242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074229242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074229254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074229264 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074229264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074229264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:32.704635 run osmo-msc_10.42.42.6(pid=23985): ERR: Terminated: ERROR {rc=2} [trial-2401↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23985)] 07:42:32.754782 run osmo-msc_10.42.42.6(pid=23985): stdout: | (launched: 2022-12-14_07:42:31.096913) 07:42:32.807946 run osmo-msc_10.42.42.6(pid=23985): stderr: | 20221214074231483 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074231483 DLGLOBAL DEBUG validating counter group 0x7fc0f1c67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074231483 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074231483 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074231483 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074231483 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074231485 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074231486 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074231486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074231486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:32.860497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23978): Terminating (SIGTERM) 07:42:32.902223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23981): Terminating (SIGTERM) 07:42:32.944695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23984): Terminating (SIGTERM) 07:42:32.987421 --- ParallelTerminationStrategy: PID 23978 died... 07:42:33.007884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23978): Terminated: ok {rc=0} 07:42:33.054824 --- ParallelTerminationStrategy: PID 23981 died... 07:42:33.075260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23981): Terminated: ok {rc=0} 07:42:33.122115 --- ParallelTerminationStrategy: PID 23984 died... 07:42:33.142594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23984): Terminated: ok {rc=0} 07:42:33.233062 bus /sierra_3: Setting Powered False 07:42:34.331887 bus /sierra_3: Setting Powered False 07:42:35.448056 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-lms --------------------------------------------------------------------- 07:42:36.677685 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:36.681832 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 07:42:36.715384 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 07:42:36.723841 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 07:42:36.762321 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 07:42:36.796851 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 07:42:36.804247 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 07:42:37.320308 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 07:42:37.325927 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 07:42:37.337190 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 07:42:37.386647 tst assert_extension.py: using LAC 39424 07:42:37.507075 tst assert_extension.py: using RAC 154 07:42:37.632194 tst assert_extension.py: using CellId 39424 07:42:37.752636 tst assert_extension.py: using BVCI 39425 07:42:37.860942 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 07:42:37.979747 tst assert_extension.py:10: start nitb and bts... 07:42:38.197191 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:42:38.853368 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23990): Launched 07:42:39.176429 run osmo-nitb_10.42.42.2(pid=23991): Launched 07:42:39.353930 run osmo-nitb_10.42.42.2(pid=23991): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23991)] 07:42:39.497377 run osmo-nitb_10.42.42.2(pid=23991): stdout: | (launched: 2022-12-14_07:42:39.116865) 07:42:39.642520 run osmo-nitb_10.42.42.2(pid=23991): stderr: | (launched: 2022-12-14_07:42:39.164596) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:42:39.787969 run osmo-nitb_10.42.42.2(pid=23991): stdout: | (launched: 2022-12-14_07:42:39.116865) 07:42:39.926826 run osmo-nitb_10.42.42.2(pid=23991): stderr: | (launched: 2022-12-14_07:42:39.164596) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23991) [trial-2401↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23991)] 07:42:40.297327 tst osmo-nitb_10.42.42.2(pid=23991): stdout: | (launched: 2022-12-14_07:42:39.116865) 07:42:40.427708 tst osmo-nitb_10.42.42.2(pid=23991): stderr: | (launched: 2022-12-14_07:42:39.164596) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:42:40.581315 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23991) [trial-2401↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23991)] [trial-2401↪nitb_ussd:trx-lms↪assert_extension.py:12] 07:42:40.590718 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:42:40.597947 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23990): Terminating (SIGTERM) 07:42:40.809338 --- ParallelTerminationStrategy: PID 23990 died... 07:42:40.830501 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23990): Terminated: ok {rc=0} 07:42:40.919877 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 ussd:trx-lms --------------------------------------------------------------------- 07:42:42.102155 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:42.106558 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 07:42:42.140236 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 07:42:42.168862 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 07:42:42.203542 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 07:42:42.237467 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 07:42:42.264854 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 07:42:42.797295 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 ussd:trx-lms assert_extension.py ---------------------------------------------- 07:42:42.802851 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:42.814273 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 07:42:42.868369 tst assert_extension.py: using LAC 39425 07:42:42.993348 tst assert_extension.py: using RAC 155 07:42:43.116797 tst assert_extension.py: using CellId 39425 07:42:43.241353 tst assert_extension.py: using BVCI 39426 07:42:43.357617 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:43.368815 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:43.379998 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:43.391091 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:43.403017 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:43.414859 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 07:42:43.533652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:43.998255 run create_hlr_db(pid=23995): Launched 07:42:44.122324 bus /sierra_2: Setting Powered False 07:42:45.182398 run create_hlr_db(pid=23995): Terminated: ok {rc=0} 07:42:45.623231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23997): Launched 07:42:45.969705 run osmo-hlr_10.42.42.2(pid=23998): Launched 07:42:46.120240 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:46.865390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24000): Launched 07:42:47.181735 run osmo-stp_10.42.42.5(pid=24001): Launched 07:42:47.334420 run osmo-msc_10.42.42.6: Starting osmo-msc 07:42:47.928593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24003): Launched 07:42:48.231737 run osmo-msc_10.42.42.6(pid=24004): Launched 07:42:48.400393 run osmo-stp_10.42.42.5(pid=24001): ERR: Terminated: ERROR {rc=1} [trial-2401↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24001)] 07:42:48.525616 run osmo-stp_10.42.42.5(pid=24001): stdout: | (launched: 2022-12-14_07:42:47.123094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:48.651309 run osmo-stp_10.42.42.5(pid=24001): stderr: | 20221214074247393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074247393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074247393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074247393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074247394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074247394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074247394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:48.775674 run osmo-stp_10.42.42.5(pid=24001): stdout: | (launched: 2022-12-14_07:42:47.123094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:48.894785 run osmo-stp_10.42.42.5(pid=24001): stderr: | 20221214074247393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074247393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074247393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074247393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074247394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074247394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074247394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:49.037470 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24001): Process ended prematurely: osmo-stp_10.42.42.5(pid=24001) [trial-2401↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24001)] [trial-2401↪ussd:trx-lms↪assert_extension.py:17] 07:42:49.045900 tst assert_extension.py:17: Test FAILED (6.2 sec) 07:42:49.072018 run osmo-hlr_10.42.42.2(pid=23998): ERR: Terminated: ERROR {rc=237} [trial-2401↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23998)] 07:42:49.119556 run osmo-hlr_10.42.42.2(pid=23998): stdout: | (launched: 2022-12-14_07:42:45.908469) 07:42:49.168673 run osmo-hlr_10.42.42.2(pid=23998): stderr: | 20221214074246260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074246260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074246260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074246260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074246260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074246260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074246278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074246295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074246296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074246296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:49.236922 run osmo-msc_10.42.42.6(pid=24004): ERR: Terminated: ERROR {rc=2} [trial-2401↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24004)] 07:42:49.284296 run osmo-msc_10.42.42.6(pid=24004): stdout: | (launched: 2022-12-14_07:42:48.175614) 07:42:49.333235 run osmo-msc_10.42.42.6(pid=24004): stderr: | 20221214074248450 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074248450 DLGLOBAL DEBUG validating counter group 0x7f56e5b1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074248450 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074248450 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074248450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074248451 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074248452 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074248453 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074248453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074248453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:49.382707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23997): Terminating (SIGTERM) 07:42:49.422412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24000): Terminating (SIGTERM) 07:42:49.461940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24003): Terminating (SIGTERM) 07:42:49.501712 --- ParallelTerminationStrategy: PID 23997 died... 07:42:49.521110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23997): Terminated: ok {rc=0} 07:42:49.565265 --- ParallelTerminationStrategy: PID 24000 died... 07:42:49.583926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24000): Terminated: ok {rc=0} 07:42:49.627588 --- ParallelTerminationStrategy: PID 24003 died... 07:42:49.646347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24003): Terminated: ok {rc=0} 07:42:49.731993 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:42:50.943367 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:50.949975 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:42:50.982689 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:42:51.009366 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:42:51.062046 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:42:51.095131 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:42:51.122485 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:42:51.669890 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:42:51.720516 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:42:51.731929 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:42:51.805086 tst mo_mt_call.py: using LAC 39426 07:42:51.926006 tst mo_mt_call.py: using RAC 156 07:42:52.045091 tst mo_mt_call.py: using CellId 39426 07:42:52.164018 tst mo_mt_call.py: using BVCI 39427 07:42:52.285101 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:42:52.296786 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:42:52.308409 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:42:52.320168 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:42:52.332373 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:42:52.344585 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:42:52.463516 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:42:52.581430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:53.055154 run create_hlr_db(pid=24009): Launched 07:42:53.180871 bus /sierra_2: Setting Powered False 07:42:54.240618 run create_hlr_db(pid=24009): Terminated: ok {rc=0} 07:42:54.687177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24011): Launched 07:42:55.017285 run osmo-hlr_10.42.42.2(pid=24012): Launched 07:42:55.143787 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:55.706564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24014): Launched 07:42:56.035862 run osmo-stp_10.42.42.5(pid=24015): Launched 07:42:56.161087 run osmo-msc_10.42.42.6: Starting osmo-msc 07:42:56.751744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24017): Launched 07:42:57.082754 run osmo-msc_10.42.42.6(pid=24018): Launched 07:42:57.265839 run osmo-stp_10.42.42.5(pid=24015): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24015)] 07:42:57.403352 run osmo-stp_10.42.42.5(pid=24015): stdout: | (launched: 2022-12-14_07:42:55.975190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:57.543299 run osmo-stp_10.42.42.5(pid=24015): stderr: | 20221214074256170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074256170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074256170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074256171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074256171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074256171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074256171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:57.680927 run osmo-stp_10.42.42.5(pid=24015): stdout: | (launched: 2022-12-14_07:42:55.975190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:57.811215 run osmo-stp_10.42.42.5(pid=24015): stderr: | 20221214074256170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074256170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074256170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074256171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074256171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074256171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074256171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:57.967163 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24015): Process ended prematurely: osmo-stp_10.42.42.5(pid=24015) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24015)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:42:57.976862 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:42:58.004909 run osmo-hlr_10.42.42.2(pid=24012): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24012)] 07:42:58.055898 run osmo-hlr_10.42.42.2(pid=24012): stdout: | (launched: 2022-12-14_07:42:54.956458) 07:42:58.108309 run osmo-hlr_10.42.42.2(pid=24012): stderr: | 20221214074255156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074255156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074255156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074255157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074255157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074255157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074255169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074255177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074255178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074255178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:58.181305 run osmo-msc_10.42.42.6(pid=24018): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24018)] 07:42:58.231185 run osmo-msc_10.42.42.6(pid=24018): stdout: | (launched: 2022-12-14_07:42:57.022198) 07:42:58.283320 run osmo-msc_10.42.42.6(pid=24018): stderr: | 20221214074257345 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074257345 DLGLOBAL DEBUG validating counter group 0x7f5738931c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074257346 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074257346 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074257346 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074257346 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074257348 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074257348 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074257348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074257348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:58.335695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24011): Terminating (SIGTERM) 07:42:58.377698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24014): Terminating (SIGTERM) 07:42:58.419832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24017): Terminating (SIGTERM) 07:42:58.462433 --- ParallelTerminationStrategy: PID 24011 died... 07:42:58.482879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24011): Terminated: ok {rc=0} 07:42:58.529609 --- ParallelTerminationStrategy: PID 24014 died... 07:42:58.549318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24014): Terminated: ok {rc=0} 07:42:58.596108 --- ParallelTerminationStrategy: PID 24017 died... 07:42:58.616300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24017): Terminated: ok {rc=0} 07:42:58.706296 bus /sierra_3: Setting Powered False 07:42:59.805048 bus /sierra_3: Setting Powered False 07:43:00.926776 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:43:02.079244 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:43:02.091706 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:43:02.161169 tst mo_mt_call_osmux.py: using LAC 39427 07:43:02.285222 tst mo_mt_call_osmux.py: using RAC 157 07:43:02.404523 tst mo_mt_call_osmux.py: using CellId 39427 07:43:02.524750 tst mo_mt_call_osmux.py: using BVCI 39428 07:43:02.635116 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:43:02.646301 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:43:02.657128 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:43:02.668071 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:43:02.679005 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:43:02.689821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:43:02.806408 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:43:02.933297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:03.441864 run create_hlr_db(pid=24020): Launched 07:43:03.568744 bus /sierra_2: Setting Powered False 07:43:04.633519 run create_hlr_db(pid=24020): Terminated: ok {rc=0} 07:43:05.073511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24022): Launched 07:43:05.383981 run osmo-hlr_10.42.42.2(pid=24023): Launched 07:43:05.502539 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:06.049674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24025): Launched 07:43:06.361503 run osmo-stp_10.42.42.5(pid=24026): Launched 07:43:06.478663 run osmo-msc_10.42.42.6: Starting osmo-msc 07:43:07.038634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24028): Launched 07:43:07.347306 run osmo-msc_10.42.42.6(pid=24029): Launched 07:43:07.520241 run osmo-stp_10.42.42.5(pid=24026): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24026)] 07:43:07.650232 run osmo-stp_10.42.42.5(pid=24026): stdout: | (launched: 2022-12-14_07:43:06.303379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:07.779377 run osmo-stp_10.42.42.5(pid=24026): stderr: | 20221214074306476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074306476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074306477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074306477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074306478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074306478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074306478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:07.906586 run osmo-stp_10.42.42.5(pid=24026): stdout: | (launched: 2022-12-14_07:43:06.303379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:08.027606 run osmo-stp_10.42.42.5(pid=24026): stderr: | 20221214074306476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074306476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074306477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074306477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074306478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074306478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074306478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:08.172476 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24026): Process ended prematurely: osmo-stp_10.42.42.5(pid=24026) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24026)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:43:08.181428 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:43:08.208144 run osmo-hlr_10.42.42.2(pid=24023): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24023)] 07:43:08.255949 run osmo-hlr_10.42.42.2(pid=24023): stdout: | (launched: 2022-12-14_07:43:05.326335) 07:43:08.305375 run osmo-hlr_10.42.42.2(pid=24023): stderr: | 20221214074305502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074305502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074305502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074305502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074305502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074305502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074305515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074305523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074305523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074305523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:08.374286 run osmo-msc_10.42.42.6(pid=24029): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24029)] 07:43:08.421702 run osmo-msc_10.42.42.6(pid=24029): stdout: | (launched: 2022-12-14_07:43:07.289797) 07:43:08.470905 run osmo-msc_10.42.42.6(pid=24029): stderr: | 20221214074307563 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074307563 DLGLOBAL DEBUG validating counter group 0x7f579fcefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074307563 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074307563 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074307563 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074307563 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074307565 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074307565 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074307566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074307566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:43:08.520565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24022): Terminating (SIGTERM) 07:43:08.560474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24025): Terminating (SIGTERM) 07:43:08.600385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24028): Terminating (SIGTERM) 07:43:08.640416 --- ParallelTerminationStrategy: PID 24022 died... 07:43:08.659637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24022): Terminated: ok {rc=0} 07:43:08.703477 --- ParallelTerminationStrategy: PID 24025 died... 07:43:08.722077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24025): Terminated: ok {rc=0} 07:43:08.765794 --- ParallelTerminationStrategy: PID 24028 died... 07:43:08.784353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24028): Terminated: ok {rc=0} 07:43:08.868151 bus /sierra_3: Setting Powered False 07:43:09.967023 bus /sierra_3: Setting Powered False 07:43:11.087426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:43:12.335691 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:43:12.342167 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:43:12.374739 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:43:12.401444 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:43:12.453207 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:43:12.486158 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:43:12.512916 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:43:13.066087 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:43:13.119960 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:13.131705 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:43:13.203556 tst mo_mt_call.py: using LAC 39428 07:43:13.331627 tst mo_mt_call.py: using RAC 158 07:43:13.464317 tst mo_mt_call.py: using CellId 39428 07:43:13.592552 tst mo_mt_call.py: using BVCI 39429 07:43:13.711398 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:13.723124 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:13.734747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:13.746272 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:13.758036 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:13.769898 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:43:13.887045 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:43:14.009750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:14.518375 run create_hlr_db(pid=24034): Launched 07:43:14.644810 bus /sierra_2: Setting Powered False 07:43:15.709444 run create_hlr_db(pid=24034): Terminated: ok {rc=0} 07:43:16.213394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24036): Launched 07:43:16.560751 run osmo-hlr_10.42.42.2(pid=24037): Launched 07:43:16.771529 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:17.449692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24039): Launched 07:43:17.758085 run osmo-stp_10.42.42.5(pid=24040): Launched 07:43:17.874560 run osmo-msc_10.42.42.6: Starting osmo-msc 07:43:18.430771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24042): Launched 07:43:18.738473 run osmo-msc_10.42.42.6(pid=24043): Launched 07:43:18.911037 run osmo-stp_10.42.42.5(pid=24040): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24040)] 07:43:19.040148 run osmo-stp_10.42.42.5(pid=24040): stdout: | (launched: 2022-12-14_07:43:17.700267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:19.169217 run osmo-stp_10.42.42.5(pid=24040): stderr: | 20221214074317872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074317872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074317872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074317873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074317873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074317873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074317873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:19.296337 run osmo-stp_10.42.42.5(pid=24040): stdout: | (launched: 2022-12-14_07:43:17.700267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:19.417699 run osmo-stp_10.42.42.5(pid=24040): stderr: | 20221214074317872 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074317872 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074317872 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074317873 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074317873 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074317873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074317873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:19.563219 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24040): Process ended prematurely: osmo-stp_10.42.42.5(pid=24040) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24040)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:43:19.572163 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 07:43:19.598359 run osmo-hlr_10.42.42.2(pid=24037): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24037)] 07:43:19.645651 run osmo-hlr_10.42.42.2(pid=24037): stdout: | (launched: 2022-12-14_07:43:16.498769) 07:43:19.694893 run osmo-hlr_10.42.42.2(pid=24037): stderr: | 20221214074316835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074316835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074316835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074316835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074316835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074316838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074316858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074316868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074316869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074316869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:19.763456 run osmo-msc_10.42.42.6(pid=24043): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24043)] 07:43:19.810788 run osmo-msc_10.42.42.6(pid=24043): stdout: | (launched: 2022-12-14_07:43:18.681186) 07:43:19.859836 run osmo-msc_10.42.42.6(pid=24043): stderr: | 20221214074318953 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074318953 DLGLOBAL DEBUG validating counter group 0x7ff8a31cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074318953 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074318953 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074318953 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074318954 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074318955 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074318956 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074318956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074318956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:43:19.909209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24036): Terminating (SIGTERM) 07:43:19.948866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24039): Terminating (SIGTERM) 07:43:19.988423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24042): Terminating (SIGTERM) 07:43:20.028109 --- ParallelTerminationStrategy: PID 24036 died... 07:43:20.047126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24036): Terminated: ok {rc=0} 07:43:20.090885 --- ParallelTerminationStrategy: PID 24039 died... 07:43:20.109334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24039): Terminated: ok {rc=0} 07:43:20.152938 --- ParallelTerminationStrategy: PID 24042 died... 07:43:20.171540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24042): Terminated: ok {rc=0} 07:43:20.257491 bus /sierra_3: Setting Powered False 07:43:21.359161 bus /sierra_3: Setting Powered False 07:43:22.475114 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:43:23.625577 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:23.638020 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:43:23.710951 tst mo_mt_call_osmux.py: using LAC 39429 07:43:23.840818 tst mo_mt_call_osmux.py: using RAC 159 07:43:23.969240 tst mo_mt_call_osmux.py: using CellId 39429 07:43:24.097357 tst mo_mt_call_osmux.py: using BVCI 39430 07:43:24.216459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:24.228460 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:24.240149 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:24.251936 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:24.263885 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:43:24.275595 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:43:24.398279 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:43:24.518786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:24.995968 run create_hlr_db(pid=24045): Launched 07:43:25.122893 bus /sierra_2: Setting Powered False 07:43:26.183922 run create_hlr_db(pid=24045): Terminated: ok {rc=0} 07:43:26.632746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24047): Launched 07:43:26.963847 run osmo-hlr_10.42.42.2(pid=24048): Launched 07:43:27.091016 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:27.660543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24050): Launched 07:43:27.991433 run osmo-stp_10.42.42.5(pid=24051): Launched 07:43:28.118581 run osmo-msc_10.42.42.6: Starting osmo-msc 07:43:28.711539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24053): Launched 07:43:29.042680 run osmo-msc_10.42.42.6(pid=24054): Launched 07:43:29.227081 run osmo-stp_10.42.42.5(pid=24051): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24051)] 07:43:29.365229 run osmo-stp_10.42.42.5(pid=24051): stdout: | (launched: 2022-12-14_07:43:27.930906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:29.504709 run osmo-stp_10.42.42.5(pid=24051): stderr: | 20221214074328123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074328123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074328123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074328123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074328124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074328124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074328124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:29.641812 run osmo-stp_10.42.42.5(pid=24051): stdout: | (launched: 2022-12-14_07:43:27.930906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:29.771457 run osmo-stp_10.42.42.5(pid=24051): stderr: | 20221214074328123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074328123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074328123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074328123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074328124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074328124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074328124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:29.927598 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24051): Process ended prematurely: osmo-stp_10.42.42.5(pid=24051) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24051)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:43:29.937501 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:43:29.965734 run osmo-hlr_10.42.42.2(pid=24048): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24048)] 07:43:30.016598 run osmo-hlr_10.42.42.2(pid=24048): stdout: | (launched: 2022-12-14_07:43:26.903291) 07:43:30.069410 run osmo-hlr_10.42.42.2(pid=24048): stderr: | 20221214074327102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074327102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074327102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074327102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074327102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074327102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074327117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074327125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074327125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074327125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:30.142177 run osmo-msc_10.42.42.6(pid=24054): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24054)] 07:43:30.192237 run osmo-msc_10.42.42.6(pid=24054): stdout: | (launched: 2022-12-14_07:43:28.981882) 07:43:30.244553 run osmo-msc_10.42.42.6(pid=24054): stderr: | 20221214074329303 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074329303 DLGLOBAL DEBUG validating counter group 0x7ff4568c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074329303 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074329303 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074329303 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074329304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074329305 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074329306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074329306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074329306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:43:30.297267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24047): Terminating (SIGTERM) 07:43:30.339378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24050): Terminating (SIGTERM) 07:43:30.382125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24053): Terminating (SIGTERM) 07:43:30.424776 --- ParallelTerminationStrategy: PID 24047 died... 07:43:30.445655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24047): Terminated: ok {rc=0} 07:43:30.492592 --- ParallelTerminationStrategy: PID 24050 died... 07:43:30.512738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24050): Terminated: ok {rc=0} 07:43:30.560196 --- ParallelTerminationStrategy: PID 24053 died... 07:43:30.580522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24053): Terminated: ok {rc=0} 07:43:30.670336 bus /sierra_3: Setting Powered False 07:43:31.774150 bus /sierra_3: Setting Powered False 07:43:32.894582 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:43:34.144417 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:43:34.151229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:43:34.183930 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:43:34.211484 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:43:34.263201 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:43:34.296197 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:43:34.322788 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:43:34.873615 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:43:34.923740 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:34.935132 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:43:35.008060 tst mo_mt_call.py: using LAC 39430 07:43:35.131002 tst mo_mt_call.py: using RAC 160 07:43:35.254330 tst mo_mt_call.py: using CellId 39430 07:43:35.376422 tst mo_mt_call.py: using BVCI 39431 07:43:35.489367 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:35.500427 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:35.511297 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:35.522636 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:35.533558 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:35.544449 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:43:35.661281 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:43:35.786968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:36.297478 run create_hlr_db(pid=24059): Launched 07:43:36.426010 bus /sierra_2: Setting Powered False 07:43:37.490477 run create_hlr_db(pid=24059): Terminated: ok {rc=0} 07:43:37.946614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24061): Launched 07:43:38.279184 run osmo-hlr_10.42.42.2(pid=24062): Launched 07:43:38.405977 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:38.977634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24064): Launched 07:43:39.308257 run osmo-stp_10.42.42.5(pid=24065): Launched 07:43:39.435517 run osmo-msc_10.42.42.6: Starting osmo-msc 07:43:40.028392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24067): Launched 07:43:40.358678 run osmo-msc_10.42.42.6(pid=24068): Launched 07:43:40.543482 run osmo-stp_10.42.42.5(pid=24065): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24065)] 07:43:40.681385 run osmo-stp_10.42.42.5(pid=24065): stdout: | (launched: 2022-12-14_07:43:39.247444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:40.820072 run osmo-stp_10.42.42.5(pid=24065): stderr: | 20221214074339441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074339442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074339442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074339442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074339443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074339443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074339443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:40.953333 run osmo-stp_10.42.42.5(pid=24065): stdout: | (launched: 2022-12-14_07:43:39.247444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:41.075669 run osmo-stp_10.42.42.5(pid=24065): stderr: | 20221214074339441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074339442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074339442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074339442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074339443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074339443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074339443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:41.221915 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24065): Process ended prematurely: osmo-stp_10.42.42.5(pid=24065) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24065)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:43:41.230995 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:43:41.257759 run osmo-hlr_10.42.42.2(pid=24062): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24062)] 07:43:41.306183 run osmo-hlr_10.42.42.2(pid=24062): stdout: | (launched: 2022-12-14_07:43:38.217783) 07:43:41.356006 run osmo-hlr_10.42.42.2(pid=24062): stderr: | 20221214074338415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074338415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074338416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074338416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074338416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074338416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074338431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074338441 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074338442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074338442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:41.425005 run osmo-msc_10.42.42.6(pid=24068): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24068)] 07:43:41.472582 run osmo-msc_10.42.42.6(pid=24068): stdout: | (launched: 2022-12-14_07:43:40.297793) 07:43:41.522138 run osmo-msc_10.42.42.6(pid=24068): stderr: | 20221214074340621 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074340621 DLGLOBAL DEBUG validating counter group 0x7f4a16f2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074340621 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074340621 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074340621 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074340621 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074340623 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074340623 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074340624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074340624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:43:41.572012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24061): Terminating (SIGTERM) 07:43:41.612093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24064): Terminating (SIGTERM) 07:43:41.652296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24067): Terminating (SIGTERM) 07:43:41.692534 --- ParallelTerminationStrategy: PID 24061 died... 07:43:41.711757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24061): Terminated: ok {rc=0} 07:43:41.755693 --- ParallelTerminationStrategy: PID 24064 died... 07:43:41.774277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24064): Terminated: ok {rc=0} 07:43:41.818553 --- ParallelTerminationStrategy: PID 24067 died... 07:43:41.837408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24067): Terminated: ok {rc=0} 07:43:41.924200 bus /sierra_3: Setting Powered False 07:43:43.023360 bus /sierra_3: Setting Powered False 07:43:44.139003 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:43:45.287751 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:45.299824 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:43:45.372873 tst mo_mt_call_osmux.py: using LAC 39431 07:43:45.497255 tst mo_mt_call_osmux.py: using RAC 161 07:43:45.617233 tst mo_mt_call_osmux.py: using CellId 39431 07:43:45.736185 tst mo_mt_call_osmux.py: using BVCI 39432 07:43:45.849979 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:45.862969 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:45.874763 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:45.892105 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:45.911077 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:43:45.927025 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:43:46.076526 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:43:46.234547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:46.734626 run create_hlr_db(pid=24070): Launched 07:43:46.893405 bus /sierra_2: Setting Powered False 07:43:47.954616 run create_hlr_db(pid=24070): Terminated: ok {rc=0} 07:43:48.403533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24072): Launched 07:43:48.734758 run osmo-hlr_10.42.42.2(pid=24073): Launched 07:43:48.862164 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:49.430415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24075): Launched 07:43:49.759114 run osmo-stp_10.42.42.5(pid=24076): Launched 07:43:49.886865 run osmo-msc_10.42.42.6: Starting osmo-msc 07:43:50.478546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24078): Launched 07:43:50.808288 run osmo-msc_10.42.42.6(pid=24079): Launched 07:43:50.993862 run osmo-stp_10.42.42.5(pid=24076): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24076)] 07:43:51.134029 run osmo-stp_10.42.42.5(pid=24076): stdout: | (launched: 2022-12-14_07:43:49.698388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:51.272707 run osmo-stp_10.42.42.5(pid=24076): stderr: | 20221214074349890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074349890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074349891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074349891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074349892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074349892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074349892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:51.410196 run osmo-stp_10.42.42.5(pid=24076): stdout: | (launched: 2022-12-14_07:43:49.698388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:51.540479 run osmo-stp_10.42.42.5(pid=24076): stderr: | 20221214074349890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074349890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074349891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074349891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074349892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074349892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074349892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:51.696836 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24076): Process ended prematurely: osmo-stp_10.42.42.5(pid=24076) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24076)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:43:51.706740 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:43:51.734991 run osmo-hlr_10.42.42.2(pid=24073): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24073)] 07:43:51.786516 run osmo-hlr_10.42.42.2(pid=24073): stdout: | (launched: 2022-12-14_07:43:48.674126) 07:43:51.839657 run osmo-hlr_10.42.42.2(pid=24073): stderr: | 20221214074348872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074348872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074348872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074348872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074348872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074348872 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074348884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074348893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074348893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074348893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:51.912818 run osmo-msc_10.42.42.6(pid=24079): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24079)] 07:43:51.962956 run osmo-msc_10.42.42.6(pid=24079): stdout: | (launched: 2022-12-14_07:43:50.747191) 07:43:52.016121 run osmo-msc_10.42.42.6(pid=24079): stderr: | 20221214074351068 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074351068 DLGLOBAL DEBUG validating counter group 0x7f336a9bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074351068 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074351068 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074351068 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074351069 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074351070 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074351071 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074351071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074351071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:43:52.069262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24072): Terminating (SIGTERM) 07:43:52.111353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24075): Terminating (SIGTERM) 07:43:52.154116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24078): Terminating (SIGTERM) 07:43:52.197128 --- ParallelTerminationStrategy: PID 24072 died... 07:43:52.218008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24072): Terminated: ok {rc=0} 07:43:52.265269 --- ParallelTerminationStrategy: PID 24075 died... 07:43:52.285631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24075): Terminated: ok {rc=0} 07:43:52.332737 --- ParallelTerminationStrategy: PID 24078 died... 07:43:52.353204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24078): Terminated: ok {rc=0} 07:43:52.443097 bus /sierra_3: Setting Powered False 07:43:53.542889 bus /sierra_3: Setting Powered False 07:43:54.662240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:43:55.923007 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:43:55.930385 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:43:55.965073 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:43:55.993054 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:43:56.045866 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:43:56.080287 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:43:56.108711 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:43:56.656667 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:43:56.706315 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:43:56.717832 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:43:56.786344 tst mo_mt_call.py: using LAC 39432 07:43:56.906430 tst mo_mt_call.py: using RAC 162 07:43:57.025793 tst mo_mt_call.py: using CellId 39432 07:43:57.144799 tst mo_mt_call.py: using BVCI 39433 07:43:57.255195 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:43:57.266312 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:43:57.277191 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:43:57.288038 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:43:57.298958 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:43:57.309900 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:43:57.427560 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:43:57.549298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:58.058283 run create_hlr_db(pid=24084): Launched 07:43:58.184169 bus /sierra_2: Setting Powered False 07:43:59.249254 run create_hlr_db(pid=24084): Terminated: ok {rc=0} 07:43:59.688706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24086): Launched 07:43:59.996832 run osmo-hlr_10.42.42.2(pid=24087): Launched 07:44:00.113248 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:00.642721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24089): Launched 07:44:00.968070 run osmo-stp_10.42.42.5(pid=24090): Launched 07:44:01.212110 run osmo-msc_10.42.42.6: Starting osmo-msc 07:44:01.911783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24092): Launched 07:44:02.237762 run osmo-msc_10.42.42.6(pid=24093): Launched 07:44:02.414694 run osmo-stp_10.42.42.5(pid=24090): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24090)] 07:44:02.543627 run osmo-stp_10.42.42.5(pid=24090): stdout: | (launched: 2022-12-14_07:44:00.906544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:02.673991 run osmo-stp_10.42.42.5(pid=24090): stderr: | 20221214074401239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074401239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074401239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074401239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074401240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074401240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074401240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:02.801661 run osmo-stp_10.42.42.5(pid=24090): stdout: | (launched: 2022-12-14_07:44:00.906544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:02.923205 run osmo-stp_10.42.42.5(pid=24090): stderr: | 20221214074401239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074401239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074401239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074401239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074401240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074401240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074401240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:03.068850 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24090): Process ended prematurely: osmo-stp_10.42.42.5(pid=24090) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24090)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:44:03.077892 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:44:03.104725 run osmo-hlr_10.42.42.2(pid=24087): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24087)] 07:44:03.152583 run osmo-hlr_10.42.42.2(pid=24087): stdout: | (launched: 2022-12-14_07:43:59.939460) 07:44:03.202381 run osmo-hlr_10.42.42.2(pid=24087): stderr: | 20221214074400117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074400117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074400117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074400117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074400117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074400117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074400129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074400138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074400138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074400138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:03.271761 run osmo-msc_10.42.42.6(pid=24093): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24093)] 07:44:03.319463 run osmo-msc_10.42.42.6(pid=24093): stdout: | (launched: 2022-12-14_07:44:02.179724) 07:44:03.368790 run osmo-msc_10.42.42.6(pid=24093): stderr: | 20221214074402452 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074402452 DLGLOBAL DEBUG validating counter group 0x7faa685f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074402452 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074402453 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074402453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074402453 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074402455 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074402455 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074402455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074402455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:44:03.418684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24086): Terminating (SIGTERM) 07:44:03.458509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24089): Terminating (SIGTERM) 07:44:03.498225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24092): Terminating (SIGTERM) 07:44:03.538331 --- ParallelTerminationStrategy: PID 24086 died... 07:44:03.557526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24086): Terminated: ok {rc=0} 07:44:03.601639 --- ParallelTerminationStrategy: PID 24089 died... 07:44:03.620147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24089): Terminated: ok {rc=0} 07:44:03.664199 --- ParallelTerminationStrategy: PID 24092 died... 07:44:03.683040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24092): Terminated: ok {rc=0} 07:44:03.769059 bus /sierra_3: Setting Powered False 07:44:04.869203 bus /sierra_3: Setting Powered False 07:44:05.983201 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:44:07.126857 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:44:07.138751 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:44:07.212772 tst mo_mt_call_osmux.py: using LAC 39433 07:44:07.332791 tst mo_mt_call_osmux.py: using RAC 163 07:44:07.451686 tst mo_mt_call_osmux.py: using CellId 39433 07:44:07.571021 tst mo_mt_call_osmux.py: using BVCI 39434 07:44:07.683069 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:44:07.694411 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:44:07.705426 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:44:07.716367 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:44:07.727425 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:44:07.738341 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:44:07.855421 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:44:07.978717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:08.492274 run create_hlr_db(pid=24095): Launched 07:44:08.620701 bus /sierra_2: Setting Powered False 07:44:09.682000 run create_hlr_db(pid=24095): Terminated: ok {rc=0} 07:44:10.113207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24097): Launched 07:44:10.423145 run osmo-hlr_10.42.42.2(pid=24098): Launched 07:44:10.541319 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:11.083613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24100): Launched 07:44:11.394748 run osmo-stp_10.42.42.5(pid=24101): Launched 07:44:11.513984 run osmo-msc_10.42.42.6: Starting osmo-msc 07:44:12.097289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24103): Launched 07:44:12.408499 run osmo-msc_10.42.42.6(pid=24104): Launched 07:44:12.583100 run osmo-stp_10.42.42.5(pid=24101): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24101)] 07:44:12.712708 run osmo-stp_10.42.42.5(pid=24101): stdout: | (launched: 2022-12-14_07:44:11.337304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:12.843743 run osmo-stp_10.42.42.5(pid=24101): stderr: | 20221214074411510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074411510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074411511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074411512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074411513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074411513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074411513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:12.971815 run osmo-stp_10.42.42.5(pid=24101): stdout: | (launched: 2022-12-14_07:44:11.337304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:13.093857 run osmo-stp_10.42.42.5(pid=24101): stderr: | 20221214074411510 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074411510 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074411511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074411512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074411513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074411513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074411513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:13.240624 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24101): Process ended prematurely: osmo-stp_10.42.42.5(pid=24101) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24101)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:44:13.249858 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:44:13.276656 run osmo-hlr_10.42.42.2(pid=24098): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24098)] 07:44:13.324897 run osmo-hlr_10.42.42.2(pid=24098): stdout: | (launched: 2022-12-14_07:44:10.365274) 07:44:13.374794 run osmo-hlr_10.42.42.2(pid=24098): stderr: | 20221214074410543 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074410543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074410543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074410543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074410543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074410543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074410555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074410563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074410564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074410564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:13.444474 run osmo-msc_10.42.42.6(pid=24104): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24104)] 07:44:13.492420 run osmo-msc_10.42.42.6(pid=24104): stdout: | (launched: 2022-12-14_07:44:12.350559) 07:44:13.541825 run osmo-msc_10.42.42.6(pid=24104): stderr: | 20221214074412625 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074412625 DLGLOBAL DEBUG validating counter group 0x7ffa824d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074412626 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074412626 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074412626 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074412626 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074412628 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074412628 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074412628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074412628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:44:13.591759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24097): Terminating (SIGTERM) 07:44:13.631752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24100): Terminating (SIGTERM) 07:44:13.671711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24103): Terminating (SIGTERM) 07:44:13.711988 --- ParallelTerminationStrategy: PID 24097 died... 07:44:13.731291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24097): Terminated: ok {rc=0} 07:44:13.775552 --- ParallelTerminationStrategy: PID 24100 died... 07:44:13.794390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24100): Terminated: ok {rc=0} 07:44:13.838411 --- ParallelTerminationStrategy: PID 24103 died... 07:44:13.857234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24103): Terminated: ok {rc=0} 07:44:13.943475 bus /sierra_3: Setting Powered False 07:44:15.042541 bus /sierra_3: Setting Powered False 07:44:16.170242 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:44:17.443209 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:44:17.449810 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:44:17.482194 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:44:17.508933 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:44:17.559749 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:44:17.593368 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:44:17.620788 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:44:18.177271 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:44:18.230572 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:18.242484 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:44:18.313415 tst mo_mt_call.py: using LAC 39434 07:44:18.441374 tst mo_mt_call.py: using RAC 164 07:44:18.571978 tst mo_mt_call.py: using CellId 39434 07:44:18.700725 tst mo_mt_call.py: using BVCI 39435 07:44:18.821880 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:18.833633 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:18.845208 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:18.856720 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:18.869089 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:18.881163 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:44:18.999723 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:44:19.119930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:19.627891 run create_hlr_db(pid=24109): Launched 07:44:19.754485 bus /sierra_2: Setting Powered False 07:44:20.819489 run create_hlr_db(pid=24109): Terminated: ok {rc=0} 07:44:21.259356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24111): Launched 07:44:21.569285 run osmo-hlr_10.42.42.2(pid=24112): Launched 07:44:21.686969 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:22.232730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24114): Launched 07:44:22.540336 run osmo-stp_10.42.42.5(pid=24115): Launched 07:44:22.658577 run osmo-msc_10.42.42.6: Starting osmo-msc 07:44:23.214108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24117): Launched 07:44:23.547943 run osmo-msc_10.42.42.6(pid=24118): Launched 07:44:23.732334 run osmo-stp_10.42.42.5(pid=24115): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24115)] 07:44:23.870947 run osmo-stp_10.42.42.5(pid=24115): stdout: | (launched: 2022-12-14_07:44:22.483289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:24.009778 run osmo-stp_10.42.42.5(pid=24115): stderr: | 20221214074422653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074422653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074422653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074422654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074422654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074422654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074422654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:24.147488 run osmo-stp_10.42.42.5(pid=24115): stdout: | (launched: 2022-12-14_07:44:22.483289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:24.277296 run osmo-stp_10.42.42.5(pid=24115): stderr: | 20221214074422653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074422653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074422653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074422654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074422654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074422654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074422654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:24.432609 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24115): Process ended prematurely: osmo-stp_10.42.42.5(pid=24115) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24115)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:44:24.442478 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:44:24.470453 run osmo-hlr_10.42.42.2(pid=24112): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24112)] 07:44:24.522186 run osmo-hlr_10.42.42.2(pid=24112): stdout: | (launched: 2022-12-14_07:44:21.512008) 07:44:24.577736 run osmo-hlr_10.42.42.2(pid=24112): stderr: | 20221214074421688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074421688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074421688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074421688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074421688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074421688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074421700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074421708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074421708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074421708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:24.651610 run osmo-msc_10.42.42.6(pid=24118): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24118)] 07:44:24.701514 run osmo-msc_10.42.42.6(pid=24118): stdout: | (launched: 2022-12-14_07:44:23.487486) 07:44:24.753797 run osmo-msc_10.42.42.6(pid=24118): stderr: | 20221214074423809 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074423809 DLGLOBAL DEBUG validating counter group 0x7fd0fb475c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074423809 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074423809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074423809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074423810 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074423811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074423812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074423812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074423812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:44:24.806072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24111): Terminating (SIGTERM) 07:44:24.848283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24114): Terminating (SIGTERM) 07:44:24.891127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24117): Terminating (SIGTERM) 07:44:24.933394 --- ParallelTerminationStrategy: PID 24111 died... 07:44:24.953654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24111): Terminated: ok {rc=0} 07:44:25.000078 --- ParallelTerminationStrategy: PID 24114 died... 07:44:25.019847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24114): Terminated: ok {rc=0} 07:44:25.066357 --- ParallelTerminationStrategy: PID 24117 died... 07:44:25.086186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24117): Terminated: ok {rc=0} 07:44:25.174645 bus /sierra_3: Setting Powered False 07:44:26.272654 bus /sierra_3: Setting Powered False 07:44:27.388503 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:44:28.540564 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:28.553091 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:44:28.625514 tst mo_mt_call_osmux.py: using LAC 39435 07:44:28.755394 tst mo_mt_call_osmux.py: using RAC 165 07:44:28.886217 tst mo_mt_call_osmux.py: using CellId 39435 07:44:29.009473 tst mo_mt_call_osmux.py: using BVCI 39436 07:44:29.120507 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:29.131949 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:29.143129 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:29.154287 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:29.165447 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:44:29.176376 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:44:29.292797 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:44:29.413333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:29.887487 run create_hlr_db(pid=24133): Launched 07:44:30.014543 bus /sierra_2: Setting Powered False 07:44:31.080211 run create_hlr_db(pid=24133): Terminated: ok {rc=0} 07:44:31.549318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24135): Launched 07:44:31.926046 run osmo-hlr_10.42.42.2(pid=24136): Launched 07:44:32.185650 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:32.730425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24138): Launched 07:44:33.040428 run osmo-stp_10.42.42.5(pid=24139): Launched 07:44:33.157474 run osmo-msc_10.42.42.6: Starting osmo-msc 07:44:33.711114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24141): Launched 07:44:34.020655 run osmo-msc_10.42.42.6(pid=24142): Launched 07:44:34.191088 run osmo-stp_10.42.42.5(pid=24139): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24139)] 07:44:34.319701 run osmo-stp_10.42.42.5(pid=24139): stdout: | (launched: 2022-12-14_07:44:32.983371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:34.448715 run osmo-stp_10.42.42.5(pid=24139): stderr: | 20221214074433154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074433154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074433155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074433155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074433156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074433156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074433156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:34.575845 run osmo-stp_10.42.42.5(pid=24139): stdout: | (launched: 2022-12-14_07:44:32.983371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:34.696751 run osmo-stp_10.42.42.5(pid=24139): stderr: | 20221214074433154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074433154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074433155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074433155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074433156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074433156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074433156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:34.842037 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24139): Process ended prematurely: osmo-stp_10.42.42.5(pid=24139) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24139)] [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:44:34.850875 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:44:34.877447 run osmo-hlr_10.42.42.2(pid=24136): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24136)] 07:44:34.925679 run osmo-hlr_10.42.42.2(pid=24136): stdout: | (launched: 2022-12-14_07:44:31.865383) 07:44:34.975117 run osmo-hlr_10.42.42.2(pid=24136): stderr: | 20221214074432161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074432161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074432161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074432161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074432161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074432161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074432175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074432183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074432183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074432183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:35.044145 run osmo-msc_10.42.42.6(pid=24142): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24142)] 07:44:35.091727 run osmo-msc_10.42.42.6(pid=24142): stdout: | (launched: 2022-12-14_07:44:33.963116) 07:44:35.141051 run osmo-msc_10.42.42.6(pid=24142): stderr: | 20221214074434233 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074434234 DLGLOBAL DEBUG validating counter group 0x7fe89bbfdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074434234 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074434234 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074434234 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074434234 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074434236 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074434236 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074434236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074434236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:44:35.190652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24135): Terminating (SIGTERM) 07:44:35.230392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24138): Terminating (SIGTERM) 07:44:35.269900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24141): Terminating (SIGTERM) 07:44:35.310018 --- ParallelTerminationStrategy: PID 24135 died... 07:44:35.329158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24135): Terminated: ok {rc=0} 07:44:35.373097 --- ParallelTerminationStrategy: PID 24138 died... 07:44:35.391737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24138): Terminated: ok {rc=0} 07:44:35.435256 --- ParallelTerminationStrategy: PID 24141 died... 07:44:35.453826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24141): Terminated: ok {rc=0} 07:44:35.539741 bus /sierra_3: Setting Powered False 07:44:36.641902 bus /sierra_3: Setting Powered False 07:44:37.758463 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:44:39.010723 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:44:39.018097 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:44:39.052564 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:44:39.080067 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:44:39.133972 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:44:39.167819 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:44:39.195705 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:44:39.746781 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:44:39.800222 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:39.812042 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:44:39.884687 tst mo_mt_call.py: using LAC 39436 07:44:40.014197 tst mo_mt_call.py: using RAC 166 07:44:40.142350 tst mo_mt_call.py: using CellId 39436 07:44:40.262801 tst mo_mt_call.py: using BVCI 39437 07:44:40.375422 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:40.387135 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:40.398380 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:40.409732 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:40.420698 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:40.431692 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:44:40.553691 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:44:40.672760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:41.150875 run create_hlr_db(pid=24147): Launched 07:44:41.279007 bus /sierra_2: Setting Powered False 07:44:42.341323 run create_hlr_db(pid=24147): Terminated: ok {rc=0} 07:44:42.790638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24149): Launched 07:44:43.121353 run osmo-hlr_10.42.42.2(pid=24150): Launched 07:44:43.248055 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:43.820908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24152): Launched 07:44:44.153694 run osmo-stp_10.42.42.5(pid=24153): Launched 07:44:44.278692 run osmo-msc_10.42.42.6: Starting osmo-msc 07:44:44.871345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24155): Launched 07:44:45.203602 run osmo-msc_10.42.42.6(pid=24156): Launched 07:44:45.387526 run osmo-stp_10.42.42.5(pid=24153): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24153)] 07:44:45.525583 run osmo-stp_10.42.42.5(pid=24153): stdout: | (launched: 2022-12-14_07:44:44.092477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:45.664308 run osmo-stp_10.42.42.5(pid=24153): stderr: | 20221214074444286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074444286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074444286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074444286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074444287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074444287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074444287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:45.801837 run osmo-stp_10.42.42.5(pid=24153): stdout: | (launched: 2022-12-14_07:44:44.092477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:45.946113 run osmo-stp_10.42.42.5(pid=24153): stderr: | 20221214074444286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074444286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074444286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074444286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074444287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074444287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074444287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:46.105609 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24153): Process ended prematurely: osmo-stp_10.42.42.5(pid=24153) [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24153)] [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:44:46.116316 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:44:46.145641 run osmo-hlr_10.42.42.2(pid=24150): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24150)] 07:44:46.200051 run osmo-hlr_10.42.42.2(pid=24150): stdout: | (launched: 2022-12-14_07:44:43.060474) 07:44:46.251995 run osmo-hlr_10.42.42.2(pid=24150): stderr: | 20221214074443260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074443260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074443260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074443261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074443261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074443261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074443272 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074443280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074443280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074443280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:46.323458 run osmo-msc_10.42.42.6(pid=24156): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24156)] 07:44:46.373267 run osmo-msc_10.42.42.6(pid=24156): stdout: | (launched: 2022-12-14_07:44:45.142062) 07:44:46.424465 run osmo-msc_10.42.42.6(pid=24156): stderr: | 20221214074445464 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074445464 DLGLOBAL DEBUG validating counter group 0x7fab376c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074445464 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074445464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074445464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074445464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074445466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074445467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074445467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074445467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:44:46.475370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24149): Terminating (SIGTERM) 07:44:46.518286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24152): Terminating (SIGTERM) 07:44:46.563592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24155): Terminating (SIGTERM) 07:44:46.607514 --- ParallelTerminationStrategy: PID 24149 died... 07:44:46.627890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24149): Terminated: ok {rc=0} 07:44:46.675187 --- ParallelTerminationStrategy: PID 24152 died... 07:44:46.695346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24152): Terminated: ok {rc=0} 07:44:46.743319 --- ParallelTerminationStrategy: PID 24155 died... 07:44:46.762716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24155): Terminated: ok {rc=0} 07:44:46.851469 bus /sierra_3: Setting Powered False 07:44:47.950645 bus /sierra_3: Setting Powered False 07:44:49.064925 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:44:50.212450 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:50.224480 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:44:50.295106 tst mo_mt_call_osmux.py: using LAC 39437 07:44:50.417282 tst mo_mt_call_osmux.py: using RAC 167 07:44:50.539979 tst mo_mt_call_osmux.py: using CellId 39437 07:44:50.669907 tst mo_mt_call_osmux.py: using BVCI 39438 07:44:50.789409 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:50.801284 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:50.812773 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:50.824710 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:50.836632 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:44:50.848418 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:44:50.970073 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:44:51.089945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:51.566708 run create_hlr_db(pid=24158): Launched 07:44:51.695348 bus /sierra_2: Setting Powered False 07:44:52.756219 run create_hlr_db(pid=24158): Terminated: ok {rc=0} 07:44:53.206801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24160): Launched 07:44:53.539372 run osmo-hlr_10.42.42.2(pid=24161): Launched 07:44:53.667606 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:54.239593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24163): Launched 07:44:54.569198 run osmo-stp_10.42.42.5(pid=24164): Launched 07:44:54.696623 run osmo-msc_10.42.42.6: Starting osmo-msc 07:44:55.296346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24166): Launched 07:44:55.628535 run osmo-msc_10.42.42.6(pid=24167): Launched 07:44:55.813418 run osmo-stp_10.42.42.5(pid=24164): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24164)] 07:44:55.951910 run osmo-stp_10.42.42.5(pid=24164): stdout: | (launched: 2022-12-14_07:44:54.508254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:56.091093 run osmo-stp_10.42.42.5(pid=24164): stderr: | 20221214074454702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074454702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074454702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074454703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074454703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074454703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074454703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:56.229585 run osmo-stp_10.42.42.5(pid=24164): stdout: | (launched: 2022-12-14_07:44:54.508254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:56.359435 run osmo-stp_10.42.42.5(pid=24164): stderr: | 20221214074454702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074454702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074454702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074454703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074454703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074454703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074454703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:56.515535 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24164): Process ended prematurely: osmo-stp_10.42.42.5(pid=24164) [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24164)] [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:44:56.525534 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:44:56.553770 run osmo-hlr_10.42.42.2(pid=24161): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24161)] 07:44:56.604566 run osmo-hlr_10.42.42.2(pid=24161): stdout: | (launched: 2022-12-14_07:44:53.478347) 07:44:56.657362 run osmo-hlr_10.42.42.2(pid=24161): stderr: | 20221214074453678 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074453678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074453678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074453678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074453678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074453679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074453691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074453702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074453702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074453702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:56.730120 run osmo-msc_10.42.42.6(pid=24167): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24167)] 07:44:56.780176 run osmo-msc_10.42.42.6(pid=24167): stdout: | (launched: 2022-12-14_07:44:55.567404) 07:44:56.833209 run osmo-msc_10.42.42.6(pid=24167): stderr: | 20221214074455892 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074455892 DLGLOBAL DEBUG validating counter group 0x7f38aec80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074455892 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074455892 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074455892 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074455893 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074455894 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074455895 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074455895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074455895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:44:56.885825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24160): Terminating (SIGTERM) 07:44:56.927928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24163): Terminating (SIGTERM) 07:44:56.970448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24166): Terminating (SIGTERM) 07:44:57.012821 --- ParallelTerminationStrategy: PID 24160 died... 07:44:57.033315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24160): Terminated: ok {rc=0} 07:44:57.079911 --- ParallelTerminationStrategy: PID 24163 died... 07:44:57.099756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24163): Terminated: ok {rc=0} 07:44:57.146275 --- ParallelTerminationStrategy: PID 24166 died... 07:44:57.166194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24166): Terminated: ok {rc=0} 07:44:57.254907 bus /sierra_3: Setting Powered False 07:44:58.353744 bus /sierra_3: Setting Powered False 07:44:59.470249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:45:00.722118 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:45:00.729182 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:45:00.761934 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:45:00.788909 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:45:00.862820 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:45:00.909188 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:45:00.936502 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:45:01.466687 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:45:01.524235 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:01.537210 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:45:01.609088 tst mo_mt_call.py: using LAC 39438 07:45:01.740682 tst mo_mt_call.py: using RAC 168 07:45:01.882870 tst mo_mt_call.py: using CellId 39438 07:45:02.017539 tst mo_mt_call.py: using BVCI 39439 07:45:02.164771 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:02.179182 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:02.193668 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:02.208227 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:02.222867 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:02.236290 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:45:02.370817 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:45:02.488559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:02.964802 run create_hlr_db(pid=24175): Launched 07:45:03.090776 bus /sierra_2: Setting Powered False 07:45:04.154885 run create_hlr_db(pid=24175): Terminated: ok {rc=0} 07:45:04.594487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24177): Launched 07:45:04.902909 run osmo-hlr_10.42.42.2(pid=24178): Launched 07:45:05.019468 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:05.547308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24180): Launched 07:45:05.878611 run osmo-stp_10.42.42.5(pid=24181): Launched 07:45:06.005089 run osmo-msc_10.42.42.6: Starting osmo-msc 07:45:06.597337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24183): Launched 07:45:06.929210 run osmo-msc_10.42.42.6(pid=24184): Launched 07:45:07.111949 run osmo-stp_10.42.42.5(pid=24181): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24181)] 07:45:07.249468 run osmo-stp_10.42.42.5(pid=24181): stdout: | (launched: 2022-12-14_07:45:05.817632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:07.388140 run osmo-stp_10.42.42.5(pid=24181): stderr: | 20221214074506010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074506010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074506011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074506011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074506011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074506012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074506012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:07.526026 run osmo-stp_10.42.42.5(pid=24181): stdout: | (launched: 2022-12-14_07:45:05.817632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:07.657046 run osmo-stp_10.42.42.5(pid=24181): stderr: | 20221214074506010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074506010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074506011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074506011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074506011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074506012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074506012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:07.812757 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24181): Process ended prematurely: osmo-stp_10.42.42.5(pid=24181) [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24181)] [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:45:07.822639 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:45:07.850631 run osmo-hlr_10.42.42.2(pid=24178): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24178)] 07:45:07.901352 run osmo-hlr_10.42.42.2(pid=24178): stdout: | (launched: 2022-12-14_07:45:04.845664) 07:45:07.953792 run osmo-hlr_10.42.42.2(pid=24178): stderr: | 20221214074505022 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074505022 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074505022 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074505022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074505022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074505022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074505034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074505043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074505043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074505043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:08.026161 run osmo-msc_10.42.42.6(pid=24184): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24184)] 07:45:08.075834 run osmo-msc_10.42.42.6(pid=24184): stdout: | (launched: 2022-12-14_07:45:06.868192) 07:45:08.127957 run osmo-msc_10.42.42.6(pid=24184): stderr: | 20221214074507192 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074507192 DLGLOBAL DEBUG validating counter group 0x7f9d5114dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074507192 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074507193 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074507193 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074507193 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074507195 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074507195 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074507195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074507195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:45:08.180039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24177): Terminating (SIGTERM) 07:45:08.221409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24180): Terminating (SIGTERM) 07:45:08.263787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24183): Terminating (SIGTERM) 07:45:08.306005 --- ParallelTerminationStrategy: PID 24177 died... 07:45:08.326321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24177): Terminated: ok {rc=0} 07:45:08.372823 --- ParallelTerminationStrategy: PID 24180 died... 07:45:08.392876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24180): Terminated: ok {rc=0} 07:45:08.438939 --- ParallelTerminationStrategy: PID 24183 died... 07:45:08.458707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24183): Terminated: ok {rc=0} 07:45:08.547446 bus /sierra_3: Setting Powered False 07:45:09.644737 bus /sierra_3: Setting Powered False 07:45:10.760454 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:45:11.906095 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:11.917639 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:45:11.987580 tst mo_mt_call_osmux.py: using LAC 39439 07:45:12.105358 tst mo_mt_call_osmux.py: using RAC 169 07:45:12.223960 tst mo_mt_call_osmux.py: using CellId 39439 07:45:12.343814 tst mo_mt_call_osmux.py: using BVCI 39440 07:45:12.454079 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:12.465061 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:12.475786 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:12.486523 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:12.497344 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:45:12.508097 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:45:12.622950 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:45:12.743222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:13.242230 run create_hlr_db(pid=24186): Launched 07:45:13.364806 bus /sierra_2: Setting Powered False 07:45:14.428082 run create_hlr_db(pid=24186): Terminated: ok {rc=0} 07:45:14.876562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24188): Launched 07:45:15.199278 run osmo-hlr_10.42.42.2(pid=24189): Launched 07:45:15.321606 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:15.881663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24191): Launched 07:45:16.257736 run osmo-stp_10.42.42.5(pid=24192): Launched 07:45:16.512800 run osmo-msc_10.42.42.6: Starting osmo-msc 07:45:17.085742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24194): Launched 07:45:17.419985 run osmo-msc_10.42.42.6(pid=24195): Launched 07:45:17.599302 run osmo-stp_10.42.42.5(pid=24192): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24192)] 07:45:17.734238 run osmo-stp_10.42.42.5(pid=24192): stdout: | (launched: 2022-12-14_07:45:16.185264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:17.870512 run osmo-stp_10.42.42.5(pid=24192): stderr: | 20221214074516386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074516386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074516386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074516387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074516387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074516387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074516387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:18.004785 run osmo-stp_10.42.42.5(pid=24192): stdout: | (launched: 2022-12-14_07:45:16.185264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:18.132747 run osmo-stp_10.42.42.5(pid=24192): stderr: | 20221214074516386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074516386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074516386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074516387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074516387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074516387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074516387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:18.285583 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24192): Process ended prematurely: osmo-stp_10.42.42.5(pid=24192) [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24192)] [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:45:18.294850 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:45:18.322422 run osmo-hlr_10.42.42.2(pid=24189): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24189)] 07:45:18.372484 run osmo-hlr_10.42.42.2(pid=24189): stdout: | (launched: 2022-12-14_07:45:15.140159) 07:45:18.424325 run osmo-hlr_10.42.42.2(pid=24189): stderr: | 20221214074515334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074515334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074515334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074515334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074515334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074515334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074515347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074515355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074515355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074515355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:18.495998 run osmo-msc_10.42.42.6(pid=24195): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24195)] 07:45:18.545896 run osmo-msc_10.42.42.6(pid=24195): stdout: | (launched: 2022-12-14_07:45:17.360214) 07:45:18.597316 run osmo-msc_10.42.42.6(pid=24195): stderr: | 20221214074517680 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074517681 DLGLOBAL DEBUG validating counter group 0x7f836232dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074517681 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074517681 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074517681 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074517681 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074517683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074517683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074517683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074517683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:45:18.648717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24188): Terminating (SIGTERM) 07:45:18.690104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24191): Terminating (SIGTERM) 07:45:18.731616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24194): Terminating (SIGTERM) 07:45:18.773447 --- ParallelTerminationStrategy: PID 24188 died... 07:45:18.793404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24188): Terminated: ok {rc=0} 07:45:18.839522 --- ParallelTerminationStrategy: PID 24191 died... 07:45:18.859061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24191): Terminated: ok {rc=0} 07:45:18.905094 --- ParallelTerminationStrategy: PID 24194 died... 07:45:18.924746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24194): Terminated: ok {rc=0} 07:45:19.012317 bus /sierra_3: Setting Powered False 07:45:20.111219 bus /sierra_3: Setting Powered False 07:45:21.227286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 emergency:trx-lms --------------------------------------------------------------------- 07:45:22.477401 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:45:22.482254 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 07:45:22.515349 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 07:45:22.543334 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 07:45:22.629257 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 07:45:22.662653 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 07:45:22.690157 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 07:45:23.272789 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2401 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 07:45:23.279993 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:23.291154 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 07:45:23.346076 tst emergency_mo_mt_call.py: using LAC 39440 07:45:23.473033 tst emergency_mo_mt_call.py: using RAC 170 07:45:23.589316 tst emergency_mo_mt_call.py: using CellId 39440 07:45:23.716524 tst emergency_mo_mt_call.py: using BVCI 39441 07:45:23.831052 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:23.842453 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:23.853324 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:23.864144 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:23.875284 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:23.886325 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:45:24.002157 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:45:24.122867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:24.613511 run create_hlr_db(pid=24200): Launched 07:45:24.735274 bus /sierra_2: Setting Powered False 07:45:25.797970 run create_hlr_db(pid=24200): Terminated: ok {rc=0} 07:45:26.239555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24202): Launched 07:45:26.555932 run osmo-hlr_10.42.42.2(pid=24203): Launched 07:45:26.676591 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:27.218083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24205): Launched 07:45:27.534750 run osmo-stp_10.42.42.5(pid=24206): Launched 07:45:27.665006 tst emergency_mo_mt_call.py: using MSISDN 8570 07:45:27.826053 run osmo-msc_10.42.42.6: Starting osmo-msc 07:45:28.396136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24208): Launched 07:45:28.713088 run osmo-msc_10.42.42.6(pid=24209): Launched 07:45:28.889882 run osmo-stp_10.42.42.5(pid=24206): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24206)] 07:45:29.022856 run osmo-stp_10.42.42.5(pid=24206): stdout: | (launched: 2022-12-14_07:45:27.476097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:29.156314 run osmo-stp_10.42.42.5(pid=24206): stderr: | 20221214074527666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074527666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074527666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074527667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074527667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074527667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074527667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:29.288075 run osmo-stp_10.42.42.5(pid=24206): stdout: | (launched: 2022-12-14_07:45:27.476097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:29.413717 run osmo-stp_10.42.42.5(pid=24206): stderr: | 20221214074527666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074527666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074527666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074527667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074527667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074527667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074527667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:29.563918 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24206): Process ended prematurely: osmo-stp_10.42.42.5(pid=24206) [trial-2401↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24206)] [trial-2401↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 07:45:29.572726 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 07:45:29.600124 run osmo-hlr_10.42.42.2(pid=24203): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24203)] 07:45:29.650641 run osmo-hlr_10.42.42.2(pid=24203): stdout: | (launched: 2022-12-14_07:45:26.497810) 07:45:29.702161 run osmo-hlr_10.42.42.2(pid=24203): stderr: | 20221214074526689 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074526689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074526689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074526689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074526689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074526689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074526701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074526709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074526710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074526710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:29.773818 run osmo-msc_10.42.42.6(pid=24209): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24209)] 07:45:29.823292 run osmo-msc_10.42.42.6(pid=24209): stdout: | (launched: 2022-12-14_07:45:28.654633) 07:45:29.875256 run osmo-msc_10.42.42.6(pid=24209): stderr: | 20221214074528972 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074528972 DLGLOBAL DEBUG validating counter group 0x7f4c24681c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074528972 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074528972 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074528972 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074528972 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074528974 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074528975 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074528975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074528975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:45:29.927164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24202): Terminating (SIGTERM) 07:45:29.968623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24205): Terminating (SIGTERM) 07:45:30.010668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24208): Terminating (SIGTERM) 07:45:30.052836 --- ParallelTerminationStrategy: PID 24202 died... 07:45:30.073158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24202): Terminated: ok {rc=0} 07:45:30.119468 --- ParallelTerminationStrategy: PID 24205 died... 07:45:30.139193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24205): Terminated: ok {rc=0} 07:45:30.185142 --- ParallelTerminationStrategy: PID 24208 died... 07:45:30.204875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24208): Terminated: ok {rc=0} 07:45:30.291573 bus /sierra_3: Setting Powered False 07:45:31.390549 bus /sierra_3: Setting Powered False 07:45:32.513516 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 07:45:33.600329 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:33.612138 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 07:45:33.661911 tst emergency_preemptive_call.py: using LAC 39441 07:45:33.776254 tst emergency_preemptive_call.py: using RAC 171 07:45:33.891285 tst emergency_preemptive_call.py: using CellId 39441 07:45:34.005806 tst emergency_preemptive_call.py: using BVCI 39442 07:45:34.111884 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:34.122725 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:34.133179 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:34.143633 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:34.154171 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:45:34.165055 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:45:34.281561 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:45:34.398173 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:45:34.516163 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:45:34.633109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:35.124727 run create_hlr_db(pid=24211): Launched 07:45:35.246896 bus /sierra_2: Setting Powered False 07:45:36.309634 run create_hlr_db(pid=24211): Terminated: ok {rc=0} 07:45:36.734282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24213): Launched 07:45:37.030378 run osmo-hlr_10.42.42.2(pid=24214): Launched 07:45:37.142737 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:37.650330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24216): Launched 07:45:37.946139 run osmo-stp_10.42.42.5(pid=24217): Launched 07:45:38.069393 tst emergency_preemptive_call.py: using MSISDN 8571 07:45:38.219713 run osmo-msc_10.42.42.6: Starting osmo-msc 07:45:38.750057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24219): Launched 07:45:39.045851 run osmo-msc_10.42.42.6(pid=24220): Launched 07:45:39.212311 run osmo-stp_10.42.42.5(pid=24217): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24217)] 07:45:39.342152 run osmo-stp_10.42.42.5(pid=24217): stdout: | (launched: 2022-12-14_07:45:37.891064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:39.468000 run osmo-stp_10.42.42.5(pid=24217): stderr: | 20221214074538058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074538058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074538059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074538059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074538059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074538060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074538060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:39.590701 run osmo-stp_10.42.42.5(pid=24217): stdout: | (launched: 2022-12-14_07:45:37.891064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:39.707946 run osmo-stp_10.42.42.5(pid=24217): stderr: | 20221214074538058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074538058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074538059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074538059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074538059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074538060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074538060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:39.848749 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24217): Process ended prematurely: osmo-stp_10.42.42.5(pid=24217) [trial-2401↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24217)] [trial-2401↪emergency:trx-lms↪emergency_preemptive_call.py:32] 07:45:39.857024 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 07:45:39.883189 run osmo-hlr_10.42.42.2(pid=24214): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24214)] 07:45:39.930484 run osmo-hlr_10.42.42.2(pid=24214): stdout: | (launched: 2022-12-14_07:45:36.975547) 07:45:39.979622 run osmo-hlr_10.42.42.2(pid=24214): stderr: | 20221214074537146 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074537146 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074537146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074537146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074537146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074537146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074537159 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074537170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074537170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074537170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:40.048237 run osmo-msc_10.42.42.6(pid=24220): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24220)] 07:45:40.095303 run osmo-msc_10.42.42.6(pid=24220): stdout: | (launched: 2022-12-14_07:45:38.990669) 07:45:40.144636 run osmo-msc_10.42.42.6(pid=24220): stderr: | 20221214074539257 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214074539257 DLGLOBAL DEBUG validating counter group 0x7f6efb151c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214074539258 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214074539258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214074539258 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214074539258 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214074539260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214074539260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214074539260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214074539260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:45:40.193779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24213): Terminating (SIGTERM) 07:45:40.233243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24216): Terminating (SIGTERM) 07:45:40.272816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24219): Terminating (SIGTERM) 07:45:40.312499 --- ParallelTerminationStrategy: PID 24213 died... 07:45:40.331462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24213): Terminated: ok {rc=0} 07:45:40.374808 --- ParallelTerminationStrategy: PID 24216 died... 07:45:40.393295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24216): Terminated: ok {rc=0} 07:45:40.436556 --- ParallelTerminationStrategy: PID 24219 died... 07:45:40.455106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24219): Terminated: ok {rc=0} 07:45:40.540082 bus /sierra_9: Setting Powered False 07:45:41.639554 bus /sierra_9: Setting Powered False 07:45:42.752516 bus /sierra_8: Setting Powered False 07:45:43.849961 bus /sierra_8: Setting Powered False 07:45:44.969407 bus /sierra_3: Setting Powered False 07:45:46.065269 bus /sierra_3: Setting Powered False 07:45:47.181749 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-lms --------------------------------------------------------------------- 07:45:48.464585 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:45:48.468811 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 07:45:48.501339 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 07:45:48.539474 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 07:45:48.625330 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 07:45:48.657404 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 07:45:48.694943 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 07:45:49.287669 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 07:45:49.338262 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:45:49.348779 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:45:49.395279 tst cs_paging_gprs_active.py: using LAC 39442 07:45:49.512157 tst cs_paging_gprs_active.py: using RAC 172 07:45:49.629426 tst cs_paging_gprs_active.py: using CellId 39442 07:45:49.745383 tst cs_paging_gprs_active.py: using BVCI 39443 07:45:49.855907 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:45:49.866491 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:45:49.876784 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:45:49.887066 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:45:49.897393 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:45:49.908169 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:45:49.919062 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:45:49.929249 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:45:49.940001 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:45:50.061693 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:45:50.182878 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:45:50.401281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:50.726675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24226): Launched 07:45:51.009796 run iperf3-srv_10.42.42.10(pid=24227): Launched 07:45:51.131887 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:45:51.342496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:51.646984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Launched 07:45:51.910915 run iperf3-srv_10.42.42.10(pid=24229): Launched 07:45:52.024582 tst cs_paging_gprs_active.py:38: start network... 07:45:52.225369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:52.693926 run create_hlr_db(pid=24234): Launched 07:45:52.818769 bus /sierra_2: Setting Powered False 07:45:53.879416 run create_hlr_db(pid=24234): Terminated: ok {rc=0} 07:45:54.304730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24236): Launched 07:45:54.610339 run osmo-hlr_10.42.42.2(pid=24237): Launched 07:45:54.726272 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:55.263142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24239): Launched 07:45:55.569934 run osmo-stp_10.42.42.5(pid=24240): Launched 07:45:55.687376 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:56.217063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24242): Launched 07:45:56.333854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:56.592255 run patchelf(pid=24243): Launched 07:45:56.763022 run osmo-stp_10.42.42.5(pid=24240): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24240)] 07:45:56.891730 run osmo-stp_10.42.42.5(pid=24240): stdout: | (launched: 2022-12-14_07:45:55.512427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:57.021636 run osmo-stp_10.42.42.5(pid=24240): stderr: | 20221214074555682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074555682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074555682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074555683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074555683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074555683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074555684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:57.151521 run osmo-stp_10.42.42.5(pid=24240): stdout: | (launched: 2022-12-14_07:45:55.512427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:57.275907 run osmo-stp_10.42.42.5(pid=24240): stderr: | 20221214074555682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074555682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074555682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074555683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074555683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074555683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074555684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:57.423419 run patchelf(pid=24243): Terminating (SIGINT) 07:45:57.596912 run patchelf(pid=24243): Terminated: ok {rc=0} 07:45:57.721524 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24240): Process ended prematurely: osmo-stp_10.42.42.5(pid=24240) [trial-2401↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24240)] [trial-2401↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 07:45:57.730742 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:45:57.757848 run osmo-hlr_10.42.42.2(pid=24237): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24237)] 07:45:57.805177 run osmo-hlr_10.42.42.2(pid=24237): stdout: | (launched: 2022-12-14_07:45:54.553841) 07:45:57.854277 run osmo-hlr_10.42.42.2(pid=24237): stderr: | 20221214074554727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074554727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074554727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074554727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074554727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074554728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074554738 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074554746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074554747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074554747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:57.903912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24226): Terminating (SIGTERM) 07:45:57.943702 run iperf3-srv_10.42.42.10(pid=24227): Terminating (SIGTERM) 07:45:57.983213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Terminating (SIGTERM) 07:45:58.022657 run iperf3-srv_10.42.42.10(pid=24229): Terminating (SIGTERM) 07:45:58.061882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24236): Terminating (SIGTERM) 07:45:58.101274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24239): Terminating (SIGTERM) 07:45:58.140665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24242): Terminating (SIGTERM) 07:45:58.180774 --- ParallelTerminationStrategy: PID 24226 died... 07:45:58.199820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24226): Terminated: ok {rc=0} 07:45:58.243357 --- ParallelTerminationStrategy: PID 24227 died... 07:45:58.261689 run iperf3-srv_10.42.42.10(pid=24227): Terminated {rc=256} 07:45:58.305321 --- ParallelTerminationStrategy: PID 24228 died... 07:45:58.323970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Terminated: ok {rc=0} 07:45:58.367545 --- ParallelTerminationStrategy: PID 24229 died... 07:45:58.386001 run iperf3-srv_10.42.42.10(pid=24229): Terminated {rc=256} 07:45:58.429325 --- ParallelTerminationStrategy: PID 24236 died... 07:45:58.447717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24236): Terminated: ok {rc=0} 07:45:58.491092 --- ParallelTerminationStrategy: PID 24239 died... 07:45:58.509504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24239): Terminated: ok {rc=0} 07:45:58.553022 --- ParallelTerminationStrategy: PID 24242 died... 07:45:58.571979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24242): Terminated: ok {rc=0} 07:45:58.655362 bus /gobi_0: Setting Powered False 07:45:59.753777 bus /gobi_0: Setting Powered False 07:46:00.888603 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms iperf3.py ---------------------------------------------- 07:46:02.050072 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:02.066856 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:46:02.134656 tst iperf3.py: using LAC 39443 07:46:02.263900 tst iperf3.py: using RAC 173 07:46:02.393117 tst iperf3.py: using CellId 39443 07:46:02.522239 tst iperf3.py: using BVCI 39444 07:46:02.633905 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:02.644809 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:02.655434 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:02.666110 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:02.676760 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:02.687414 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:02.697915 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:02.708264 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:02.718747 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:46:02.838309 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:46:03.059254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:03.387402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Launched 07:46:03.673694 run iperf3-srv_10.42.42.10(pid=24245): Launched 07:46:03.797782 tst iperf3.py:8: start network... 07:46:04.020125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:04.529683 run create_hlr_db(pid=24246): Launched 07:46:04.655850 bus /gobi_6: Setting Powered False 07:46:05.719844 run create_hlr_db(pid=24246): Terminated: ok {rc=0} 07:46:06.156413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24248): Launched 07:46:06.462693 run osmo-hlr_10.42.42.2(pid=24249): Launched 07:46:06.580695 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:07.106368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24251): Launched 07:46:07.412853 run osmo-stp_10.42.42.5(pid=24252): Launched 07:46:07.530287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:08.056034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24254): Launched 07:46:08.173860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:08.431612 run patchelf(pid=24255): Launched 07:46:08.602698 run osmo-stp_10.42.42.5(pid=24252): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24252)] 07:46:08.731424 run osmo-stp_10.42.42.5(pid=24252): stdout: | (launched: 2022-12-14_07:46:07.356436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:08.861738 run osmo-stp_10.42.42.5(pid=24252): stderr: | 20221214074607524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074607524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074607524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074607525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074607525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074607526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074607526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:08.992135 run osmo-stp_10.42.42.5(pid=24252): stdout: | (launched: 2022-12-14_07:46:07.356436) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:09.116301 run osmo-stp_10.42.42.5(pid=24252): stderr: | 20221214074607524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074607524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074607524 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074607525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074607525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074607526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074607526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:09.263467 run patchelf(pid=24255): Terminating (SIGINT) 07:46:09.436411 run patchelf(pid=24255): Terminated: ok {rc=0} 07:46:09.561167 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24252): Process ended prematurely: osmo-stp_10.42.42.5(pid=24252) [trial-2401↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24252)] [trial-2401↪gprs:trx-lms↪iperf3.py:8] 07:46:09.570411 tst iperf3.py:8: Test FAILED (7.6 sec) 07:46:09.598506 run osmo-hlr_10.42.42.2(pid=24249): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24249)] 07:46:09.646565 run osmo-hlr_10.42.42.2(pid=24249): stdout: | (launched: 2022-12-14_07:46:06.406470) 07:46:09.696170 run osmo-hlr_10.42.42.2(pid=24249): stderr: | 20221214074606579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074606579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074606579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074606579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074606579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074606579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074606591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074606601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074606601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074606601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:09.745816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Terminating (SIGTERM) 07:46:09.785635 run iperf3-srv_10.42.42.10(pid=24245): Terminating (SIGTERM) 07:46:09.825200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24248): Terminating (SIGTERM) 07:46:09.865215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24251): Terminating (SIGTERM) 07:46:09.905052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24254): Terminating (SIGTERM) 07:46:09.944780 --- ParallelTerminationStrategy: PID 24244 died... 07:46:09.963990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Terminated: ok {rc=0} 07:46:10.007686 --- ParallelTerminationStrategy: PID 24245 died... 07:46:10.026209 run iperf3-srv_10.42.42.10(pid=24245): Terminated {rc=256} 07:46:10.069512 --- ParallelTerminationStrategy: PID 24248 died... 07:46:10.088105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24248): Terminated: ok {rc=0} 07:46:10.131907 --- ParallelTerminationStrategy: PID 24251 died... 07:46:10.150460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24251): Terminated: ok {rc=0} 07:46:10.194006 --- ParallelTerminationStrategy: PID 24254 died... 07:46:10.212714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24254): Terminated: ok {rc=0} 07:46:10.295650 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms iperf3m4.py ---------------------------------------------- 07:46:11.439198 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:11.450555 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:46:11.500896 tst iperf3m4.py: using LAC 39444 07:46:11.621988 tst iperf3m4.py: using RAC 174 07:46:11.745165 tst iperf3m4.py: using CellId 39444 07:46:11.866689 tst iperf3m4.py: using BVCI 39445 07:46:11.987744 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:11.999096 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:12.010246 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:12.021370 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:12.032837 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:12.044250 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:12.055580 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:12.066751 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:12.078095 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:46:12.197326 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:46:12.321294 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:46:12.442946 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:46:12.564440 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:46:12.769367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:13.075671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24256): Launched 07:46:13.341793 run iperf3-srv_10.42.42.10(pid=24257): Launched 07:46:13.456557 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:46:13.661268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:13.970200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24258): Launched 07:46:14.236172 run iperf3-srv_10.42.42.10(pid=24259): Launched 07:46:14.350990 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:46:14.554573 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:14.859465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24260): Launched 07:46:15.125770 run iperf3-srv_10.42.42.10(pid=24261): Launched 07:46:15.241141 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:46:15.445764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:15.754576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24262): Launched 07:46:16.076177 run iperf3-srv_10.42.42.10(pid=24263): Launched 07:46:16.209161 tst iperf3m4.py:8: start network... 07:46:16.416931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:16.905706 run create_hlr_db(pid=24264): Launched 07:46:17.070669 bus /gobi_6: Setting Powered False 07:46:18.135645 run create_hlr_db(pid=24264): Terminated: ok {rc=0} 07:46:18.592172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24266): Launched 07:46:18.923000 run osmo-hlr_10.42.42.2(pid=24267): Launched 07:46:19.050358 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:19.616614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24269): Launched 07:46:19.946682 run osmo-stp_10.42.42.5(pid=24270): Launched 07:46:20.071708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:20.634241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24272): Launched 07:46:20.762132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:21.039622 run patchelf(pid=24273): Launched 07:46:21.223998 run osmo-stp_10.42.42.5(pid=24270): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24270)] 07:46:21.362975 run osmo-stp_10.42.42.5(pid=24270): stdout: | (launched: 2022-12-14_07:46:19.886729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:21.503187 run osmo-stp_10.42.42.5(pid=24270): stderr: | 20221214074620075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074620075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074620076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074620076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074620077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074620077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074620077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:21.643234 run osmo-stp_10.42.42.5(pid=24270): stdout: | (launched: 2022-12-14_07:46:19.886729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:21.776866 run osmo-stp_10.42.42.5(pid=24270): stderr: | 20221214074620075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074620075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074620076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074620076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074620077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074620077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074620077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:21.936083 run patchelf(pid=24273): Terminating (SIGINT) 07:46:22.120286 run patchelf(pid=24273): Terminated: ok {rc=0} 07:46:22.253404 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24270): Process ended prematurely: osmo-stp_10.42.42.5(pid=24270) [trial-2401↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24270)] [trial-2401↪gprs:trx-lms↪iperf3m4.py:8] 07:46:22.263462 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:46:22.292224 run osmo-hlr_10.42.42.2(pid=24267): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24267)] 07:46:22.342792 run osmo-hlr_10.42.42.2(pid=24267): stdout: | (launched: 2022-12-14_07:46:18.862385) 07:46:22.394892 run osmo-hlr_10.42.42.2(pid=24267): stderr: | 20221214074619058 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074619058 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074619058 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074619058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074619058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074619058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074619071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074619080 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074619080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074619080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:22.447076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24256): Terminating (SIGTERM) 07:46:22.488878 run iperf3-srv_10.42.42.10(pid=24257): Terminating (SIGTERM) 07:46:22.530670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24258): Terminating (SIGTERM) 07:46:22.572545 run iperf3-srv_10.42.42.10(pid=24259): Terminating (SIGTERM) 07:46:22.614323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24260): Terminating (SIGTERM) 07:46:22.656248 run iperf3-srv_10.42.42.10(pid=24261): Terminating (SIGTERM) 07:46:22.698151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24262): Terminating (SIGTERM) 07:46:22.740099 run iperf3-srv_10.42.42.10(pid=24263): Terminating (SIGTERM) 07:46:22.781971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24266): Terminating (SIGTERM) 07:46:22.823902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24269): Terminating (SIGTERM) 07:46:22.865938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24272): Terminating (SIGTERM) 07:46:22.908345 --- ParallelTerminationStrategy: PID 24256 died... 07:46:22.928682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24256): Terminated: ok {rc=0} 07:46:22.975493 --- ParallelTerminationStrategy: PID 24257 died... 07:46:22.995141 run iperf3-srv_10.42.42.10(pid=24257): Terminated {rc=256} 07:46:23.041146 --- ParallelTerminationStrategy: PID 24258 died... 07:46:23.060790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24258): Terminated: ok {rc=0} 07:46:23.106877 --- ParallelTerminationStrategy: PID 24259 died... 07:46:23.126596 run iperf3-srv_10.42.42.10(pid=24259): Terminated {rc=256} 07:46:23.172551 --- ParallelTerminationStrategy: PID 24260 died... 07:46:23.192229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24260): Terminated: ok {rc=0} 07:46:23.238347 --- ParallelTerminationStrategy: PID 24261 died... 07:46:23.258041 run iperf3-srv_10.42.42.10(pid=24261): Terminated {rc=256} 07:46:23.304108 --- ParallelTerminationStrategy: PID 24262 died... 07:46:23.323953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24262): Terminated: ok {rc=0} 07:46:23.370013 --- ParallelTerminationStrategy: PID 24263 died... 07:46:23.389672 run iperf3-srv_10.42.42.10(pid=24263): Terminated {rc=256} 07:46:23.435683 --- ParallelTerminationStrategy: PID 24266 died... 07:46:23.455499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24266): Terminated: ok {rc=0} 07:46:23.501591 --- ParallelTerminationStrategy: PID 24269 died... 07:46:23.521414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24269): Terminated: ok {rc=0} 07:46:23.567643 --- ParallelTerminationStrategy: PID 24272 died... 07:46:23.587408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24272): Terminated: ok {rc=0} 07:46:23.674772 bus /gobi_4: Setting Powered False 07:46:24.773167 bus /gobi_4: Setting Powered False 07:46:25.888131 bus /gobi_1: Setting Powered False 07:46:26.986962 bus /gobi_1: Setting Powered False 07:46:28.100469 bus /gobi_0: Setting Powered False 07:46:29.196072 bus /gobi_0: Setting Powered False 07:46:30.309387 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms ping.py ---------------------------------------------- 07:46:31.414370 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:31.425677 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:46:31.475342 tst ping.py: using LAC 39445 07:46:31.640392 tst ping.py: using RAC 175 07:46:31.796749 tst ping.py: using CellId 39445 07:46:31.925788 tst ping.py: using BVCI 39446 07:46:32.076879 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:32.088447 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:32.100052 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:32.111696 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:32.123446 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:32.135118 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:32.146550 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:32.159293 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:46:32.284167 tst ping.py:19: start network... 07:46:32.505544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:33.002646 run create_hlr_db(pid=24274): Launched 07:46:33.125142 bus /gobi_6: Setting Powered False 07:46:34.189061 run create_hlr_db(pid=24274): Terminated: ok {rc=0} 07:46:34.619134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24276): Launched 07:46:34.918184 run osmo-hlr_10.42.42.2(pid=24277): Launched 07:46:35.032133 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:35.565783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24279): Launched 07:46:35.868885 run osmo-stp_10.42.42.5(pid=24280): Launched 07:46:35.983853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:36.499020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24282): Launched 07:46:36.613782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:36.866290 run patchelf(pid=24283): Launched 07:46:37.033928 run osmo-stp_10.42.42.5(pid=24280): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24280)] 07:46:37.160616 run osmo-stp_10.42.42.5(pid=24280): stdout: | (launched: 2022-12-14_07:46:35.812158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:37.288845 run osmo-stp_10.42.42.5(pid=24280): stderr: | 20221214074635982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074635982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074635983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074635983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074635983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074635984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074635984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:37.417745 run osmo-stp_10.42.42.5(pid=24280): stdout: | (launched: 2022-12-14_07:46:35.812158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:37.540014 run osmo-stp_10.42.42.5(pid=24280): stderr: | 20221214074635982 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074635982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074635983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074635983 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074635983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074635984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074635984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:37.684739 run patchelf(pid=24283): Terminating (SIGINT) 07:46:37.854458 run patchelf(pid=24283): Terminated: ok {rc=0} 07:46:37.977324 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24280): Process ended prematurely: osmo-stp_10.42.42.5(pid=24280) [trial-2401↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24280)] [trial-2401↪gprs:trx-lms↪ping.py:22] 07:46:37.986197 tst ping.py:22: Test FAILED (6.6 sec) 07:46:38.012703 run osmo-hlr_10.42.42.2(pid=24277): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24277)] 07:46:38.059820 run osmo-hlr_10.42.42.2(pid=24277): stdout: | (launched: 2022-12-14_07:46:34.863001) 07:46:38.108525 run osmo-hlr_10.42.42.2(pid=24277): stderr: | 20221214074635037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074635037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074635037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074635037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074635037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074635038 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074635050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074635058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074635059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074635059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:38.157660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24276): Terminating (SIGTERM) 07:46:38.197357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24279): Terminating (SIGTERM) 07:46:38.236666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24282): Terminating (SIGTERM) 07:46:38.276436 --- ParallelTerminationStrategy: PID 24276 died... 07:46:38.295693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24276): Terminated: ok {rc=0} 07:46:38.338962 --- ParallelTerminationStrategy: PID 24279 died... 07:46:38.357372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24279): Terminated: ok {rc=0} 07:46:38.400587 --- ParallelTerminationStrategy: PID 24282 died... 07:46:38.419193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24282): Terminated: ok {rc=0} 07:46:38.504115 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 07:46:39.593573 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:39.605069 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:46:39.654128 tst ping_idle_ping.py: using LAC 39446 07:46:39.773036 tst ping_idle_ping.py: using RAC 176 07:46:39.892267 tst ping_idle_ping.py: using CellId 39446 07:46:40.011744 tst ping_idle_ping.py: using BVCI 39447 07:46:40.121433 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:40.132109 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:40.142861 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:40.153231 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:40.163885 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:40.174957 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:40.185957 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:46:40.196942 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:46:40.317273 tst ping_idle_ping.py:24: start network... 07:46:40.534542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:41.034862 run create_hlr_db(pid=24284): Launched 07:46:41.158608 bus /gobi_6: Setting Powered False 07:46:42.223103 run create_hlr_db(pid=24284): Terminated: ok {rc=0} 07:46:42.673159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24286): Launched 07:46:42.996297 run osmo-hlr_10.42.42.2(pid=24287): Launched 07:46:43.121371 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:43.678822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24289): Launched 07:46:44.003176 run osmo-stp_10.42.42.5(pid=24290): Launched 07:46:44.128180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:44.683494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24292): Launched 07:46:44.808744 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:45.081568 run patchelf(pid=24293): Launched 07:46:45.262812 run osmo-stp_10.42.42.5(pid=24290): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24290)] 07:46:45.400230 run osmo-stp_10.42.42.5(pid=24290): stdout: | (launched: 2022-12-14_07:46:43.943999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:45.539161 run osmo-stp_10.42.42.5(pid=24290): stderr: | 20221214074644130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074644130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074644130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074644131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074644131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074644131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074644131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:45.678492 run osmo-stp_10.42.42.5(pid=24290): stdout: | (launched: 2022-12-14_07:46:43.943999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:45.810842 run osmo-stp_10.42.42.5(pid=24290): stderr: | 20221214074644130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074644130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074644130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074644131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074644131 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074644131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074644131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:45.975065 run patchelf(pid=24293): Terminating (SIGINT) 07:46:46.170458 run patchelf(pid=24293): Terminated: ok {rc=0} 07:46:46.305641 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24290): Process ended prematurely: osmo-stp_10.42.42.5(pid=24290) [trial-2401↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24290)] [trial-2401↪gprs:trx-lms↪ping_idle_ping.py:27] 07:46:46.316312 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:46:46.345889 run osmo-hlr_10.42.42.2(pid=24287): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24287)] 07:46:46.400168 run osmo-hlr_10.42.42.2(pid=24287): stdout: | (launched: 2022-12-14_07:46:42.937378) 07:46:46.454484 run osmo-hlr_10.42.42.2(pid=24287): stderr: | 20221214074643130 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074643130 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074643130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074643130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074643130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074643130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074643142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074643151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074643152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074643152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:46.509301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24286): Terminating (SIGTERM) 07:46:46.552751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24289): Terminating (SIGTERM) 07:46:46.598923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24292): Terminating (SIGTERM) 07:46:46.644813 --- ParallelTerminationStrategy: PID 24286 died... 07:46:46.666743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24286): Terminated: ok {rc=0} 07:46:46.716726 --- ParallelTerminationStrategy: PID 24289 died... 07:46:46.737472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24289): Terminated: ok {rc=0} 07:46:46.787143 --- ParallelTerminationStrategy: PID 24292 died... 07:46:46.807584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24292): Terminated: ok {rc=0} 07:46:46.898757 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 07:46:48.200831 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:46:48.206955 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:46:48.241764 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:46:48.281502 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:46:48.371287 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:46:48.405305 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:46:48.445123 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:46:49.038652 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:46:49.093107 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:46:49.104635 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:46:49.157224 tst cs_paging_gprs_active.py: using LAC 39447 07:46:49.287809 tst cs_paging_gprs_active.py: using RAC 177 07:46:49.411293 tst cs_paging_gprs_active.py: using CellId 39447 07:46:49.533339 tst cs_paging_gprs_active.py: using BVCI 39448 07:46:49.644335 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:46:49.655228 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:46:49.666004 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:46:49.676613 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:46:49.687197 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:46:49.697746 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:46:49.708479 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:46:49.718992 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:46:49.729758 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:46:49.845641 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:46:49.968341 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:46:50.191298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:50.522724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24297): Launched 07:46:50.812798 run iperf3-srv_10.42.42.10(pid=24298): Launched 07:46:50.937496 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:46:51.159131 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:46:51.489151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24299): Launched 07:46:51.776851 run iperf3-srv_10.42.42.10(pid=24300): Launched 07:46:51.903254 tst cs_paging_gprs_active.py:38: start network... 07:46:52.126700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:52.633606 run create_hlr_db(pid=24302): Launched 07:46:52.762151 bus /gobi_6: Setting Powered False 07:46:53.826228 run create_hlr_db(pid=24302): Terminated: ok {rc=0} 07:46:54.264005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Launched 07:46:54.571280 run osmo-hlr_10.42.42.2(pid=24305): Launched 07:46:54.689954 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:55.217221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Launched 07:46:55.524717 run osmo-stp_10.42.42.5(pid=24308): Launched 07:46:55.642935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:56.170877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24310): Launched 07:46:56.290197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:56.549720 run patchelf(pid=24311): Launched 07:46:56.723910 run osmo-stp_10.42.42.5(pid=24308): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] 07:46:56.854891 run osmo-stp_10.42.42.5(pid=24308): stdout: | (launched: 2022-12-14_07:46:55.468171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:56.986512 run osmo-stp_10.42.42.5(pid=24308): stderr: | 20221214074655638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074655638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074655638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074655639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074655639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074655640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074655640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:57.118414 run osmo-stp_10.42.42.5(pid=24308): stdout: | (launched: 2022-12-14_07:46:55.468171) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:57.244510 run osmo-stp_10.42.42.5(pid=24308): stderr: | 20221214074655638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074655638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074655638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074655639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074655639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074655640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074655640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:57.394366 run patchelf(pid=24311): Terminating (SIGINT) 07:46:57.569471 run patchelf(pid=24311): Terminated: ok {rc=0} 07:46:57.695326 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24308): Process ended prematurely: osmo-stp_10.42.42.5(pid=24308) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:46:57.704766 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:46:57.731828 run osmo-hlr_10.42.42.2(pid=24305): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24305)] 07:46:57.779416 run osmo-hlr_10.42.42.2(pid=24305): stdout: | (launched: 2022-12-14_07:46:54.514731) 07:46:57.828272 run osmo-hlr_10.42.42.2(pid=24305): stderr: | 20221214074654688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074654688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074654688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074654688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074654688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074654688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074654700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074654710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074654710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074654710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:57.877895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24297): Terminating (SIGTERM) 07:46:57.917899 run iperf3-srv_10.42.42.10(pid=24298): Terminating (SIGTERM) 07:46:57.957583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24299): Terminating (SIGTERM) 07:46:57.997380 run iperf3-srv_10.42.42.10(pid=24300): Terminating (SIGTERM) 07:46:58.037285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Terminating (SIGTERM) 07:46:58.077638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Terminating (SIGTERM) 07:46:58.117445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24310): Terminating (SIGTERM) 07:46:58.157446 --- ParallelTerminationStrategy: PID 24297 died... 07:46:58.176750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24297): Terminated: ok {rc=0} 07:46:58.220921 --- ParallelTerminationStrategy: PID 24298 died... 07:46:58.239583 run iperf3-srv_10.42.42.10(pid=24298): Terminated {rc=256} 07:46:58.283129 --- ParallelTerminationStrategy: PID 24299 died... 07:46:58.301920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24299): Terminated: ok {rc=0} 07:46:58.345736 --- ParallelTerminationStrategy: PID 24300 died... 07:46:58.364364 run iperf3-srv_10.42.42.10(pid=24300): Terminated {rc=256} 07:46:58.407947 --- ParallelTerminationStrategy: PID 24304 died... 07:46:58.426538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24304): Terminated: ok {rc=0} 07:46:58.470370 --- ParallelTerminationStrategy: PID 24307 died... 07:46:58.489111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24307): Terminated: ok {rc=0} 07:46:58.532863 --- ParallelTerminationStrategy: PID 24310 died... 07:46:58.552024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24310): Terminated: ok {rc=0} 07:46:58.635544 bus /gobi_0: Setting Powered False 07:46:59.734184 bus /gobi_0: Setting Powered False 07:47:00.854961 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:47:02.022489 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:02.039050 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:47:02.107061 tst iperf3.py: using LAC 39448 07:47:02.238006 tst iperf3.py: using RAC 178 07:47:02.371637 tst iperf3.py: using CellId 39448 07:47:02.499420 tst iperf3.py: using BVCI 39449 07:47:02.621115 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:02.632701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:02.644001 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:02.655187 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:02.666917 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:02.678489 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:02.690334 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:02.701875 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:02.713521 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:47:02.834159 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:47:03.056525 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:03.385876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24312): Launched 07:47:03.674322 run iperf3-srv_10.42.42.10(pid=24313): Launched 07:47:03.799799 tst iperf3.py:8: start network... 07:47:04.021489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:04.529220 run create_hlr_db(pid=24314): Launched 07:47:04.655605 bus /gobi_6: Setting Powered False 07:47:05.720677 run create_hlr_db(pid=24314): Terminated: ok {rc=0} 07:47:06.161648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Launched 07:47:06.470911 run osmo-hlr_10.42.42.2(pid=24317): Launched 07:47:06.588547 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:07.113361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Launched 07:47:07.418005 run osmo-stp_10.42.42.5(pid=24320): Launched 07:47:07.534426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:08.059297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24322): Launched 07:47:08.177411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:08.434740 run patchelf(pid=24323): Launched 07:47:08.605278 run osmo-stp_10.42.42.5(pid=24320): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] 07:47:08.733622 run osmo-stp_10.42.42.5(pid=24320): stdout: | (launched: 2022-12-14_07:47:07.361958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:08.864077 run osmo-stp_10.42.42.5(pid=24320): stderr: | 20221214074707530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074707530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074707531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074707531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074707531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074707532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074707532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:08.994511 run osmo-stp_10.42.42.5(pid=24320): stdout: | (launched: 2022-12-14_07:47:07.361958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:09.118696 run osmo-stp_10.42.42.5(pid=24320): stderr: | 20221214074707530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074707530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074707531 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074707531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074707531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074707532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074707532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:09.265924 run patchelf(pid=24323): Terminating (SIGINT) 07:47:09.438134 run patchelf(pid=24323): Terminated: ok {rc=0} 07:47:09.562859 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24320): Process ended prematurely: osmo-stp_10.42.42.5(pid=24320) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 07:47:09.572207 tst iperf3.py:8: Test FAILED (7.6 sec) 07:47:09.599293 run osmo-hlr_10.42.42.2(pid=24317): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24317)] 07:47:09.646998 run osmo-hlr_10.42.42.2(pid=24317): stdout: | (launched: 2022-12-14_07:47:06.414349) 07:47:09.696875 run osmo-hlr_10.42.42.2(pid=24317): stderr: | 20221214074706587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074706587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074706587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074706587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074706587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074706587 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074706598 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074706607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074706607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074706607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:09.746850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24312): Terminating (SIGTERM) 07:47:09.786798 run iperf3-srv_10.42.42.10(pid=24313): Terminating (SIGTERM) 07:47:09.826466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Terminating (SIGTERM) 07:47:09.866210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Terminating (SIGTERM) 07:47:09.906089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24322): Terminating (SIGTERM) 07:47:09.946119 --- ParallelTerminationStrategy: PID 24312 died... 07:47:09.965350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24312): Terminated: ok {rc=0} 07:47:10.009172 --- ParallelTerminationStrategy: PID 24313 died... 07:47:10.028079 run iperf3-srv_10.42.42.10(pid=24313): Terminated {rc=256} 07:47:10.071429 --- ParallelTerminationStrategy: PID 24316 died... 07:47:10.090261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24316): Terminated: ok {rc=0} 07:47:10.134527 --- ParallelTerminationStrategy: PID 24319 died... 07:47:10.153449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24319): Terminated: ok {rc=0} 07:47:10.197216 --- ParallelTerminationStrategy: PID 24322 died... 07:47:10.215930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24322): Terminated: ok {rc=0} 07:47:10.302320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:47:11.449831 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:11.461440 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:47:11.511637 tst iperf3m4.py: using LAC 39449 07:47:11.636474 tst iperf3m4.py: using RAC 179 07:47:11.755283 tst iperf3m4.py: using CellId 39449 07:47:11.883348 tst iperf3m4.py: using BVCI 39450 07:47:12.003229 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:12.014830 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:12.026128 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:12.037418 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:12.049554 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:12.060874 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:12.072457 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:12.083812 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:12.095351 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:47:12.213913 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:47:12.335346 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:47:12.457251 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:47:12.577512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:47:12.782940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:13.088613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24325): Launched 07:47:13.355731 run iperf3-srv_10.42.42.10(pid=24326): Launched 07:47:13.471171 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:47:13.674921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:13.981671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24327): Launched 07:47:14.251251 run iperf3-srv_10.42.42.10(pid=24328): Launched 07:47:14.366391 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:47:14.570386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:14.877428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24329): Launched 07:47:15.146271 run iperf3-srv_10.42.42.10(pid=24330): Launched 07:47:15.261331 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:47:15.465063 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:15.771622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24331): Launched 07:47:16.093069 run iperf3-srv_10.42.42.10(pid=24332): Launched 07:47:16.261987 tst iperf3m4.py:8: start network... 07:47:16.490488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:17.016744 run create_hlr_db(pid=24333): Launched 07:47:17.147750 bus /gobi_6: Setting Powered False 07:47:18.211891 run create_hlr_db(pid=24333): Terminated: ok {rc=0} 07:47:18.651157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24335): Launched 07:47:18.959595 run osmo-hlr_10.42.42.2(pid=24336): Launched 07:47:19.075175 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:19.600898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24338): Launched 07:47:19.909186 run osmo-stp_10.42.42.5(pid=24339): Launched 07:47:20.024909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:20.549810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24341): Launched 07:47:20.667711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:20.927313 run patchelf(pid=24342): Launched 07:47:21.098614 run osmo-stp_10.42.42.5(pid=24339): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24339)] 07:47:21.226844 run osmo-stp_10.42.42.5(pid=24339): stdout: | (launched: 2022-12-14_07:47:19.852103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:21.356918 run osmo-stp_10.42.42.5(pid=24339): stderr: | 20221214074720022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074720022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074720022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074720023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074720023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074720023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074720023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:21.486990 run osmo-stp_10.42.42.5(pid=24339): stdout: | (launched: 2022-12-14_07:47:19.852103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:21.610736 run osmo-stp_10.42.42.5(pid=24339): stderr: | 20221214074720022 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074720022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074720022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074720023 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074720023 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074720023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074720023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:21.757974 run patchelf(pid=24342): Terminating (SIGINT) 07:47:21.930518 run patchelf(pid=24342): Terminated: ok {rc=0} 07:47:22.054988 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24339): Process ended prematurely: osmo-stp_10.42.42.5(pid=24339) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24339)] [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 07:47:22.064378 tst iperf3m4.py:8: Test FAILED (10.7 sec) 07:47:22.091804 run osmo-hlr_10.42.42.2(pid=24336): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24336)] 07:47:22.138880 run osmo-hlr_10.42.42.2(pid=24336): stdout: | (launched: 2022-12-14_07:47:18.903147) 07:47:22.187979 run osmo-hlr_10.42.42.2(pid=24336): stderr: | 20221214074719074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074719074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074719074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074719074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074719074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074719075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074719111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074719121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074719122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074719122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:22.237614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24325): Terminating (SIGTERM) 07:47:22.277103 run iperf3-srv_10.42.42.10(pid=24326): Terminating (SIGTERM) 07:47:22.316145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24327): Terminating (SIGTERM) 07:47:22.355572 run iperf3-srv_10.42.42.10(pid=24328): Terminating (SIGTERM) 07:47:22.394569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24329): Terminating (SIGTERM) 07:47:22.433656 run iperf3-srv_10.42.42.10(pid=24330): Terminating (SIGTERM) 07:47:22.472588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24331): Terminating (SIGTERM) 07:47:22.511874 run iperf3-srv_10.42.42.10(pid=24332): Terminating (SIGTERM) 07:47:22.550852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24335): Terminating (SIGTERM) 07:47:22.589918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24338): Terminating (SIGTERM) 07:47:22.629043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24341): Terminating (SIGTERM) 07:47:22.668440 --- ParallelTerminationStrategy: PID 24325 died... 07:47:22.687490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24325): Terminated: ok {rc=0} 07:47:22.730930 --- ParallelTerminationStrategy: PID 24326 died... 07:47:22.749276 run iperf3-srv_10.42.42.10(pid=24326): Terminated {rc=256} 07:47:22.792346 --- ParallelTerminationStrategy: PID 24327 died... 07:47:22.810948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24327): Terminated: ok {rc=0} 07:47:22.854386 --- ParallelTerminationStrategy: PID 24328 died... 07:47:22.872761 run iperf3-srv_10.42.42.10(pid=24328): Terminated {rc=256} 07:47:22.915906 --- ParallelTerminationStrategy: PID 24329 died... 07:47:22.934333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24329): Terminated: ok {rc=0} 07:47:22.977737 --- ParallelTerminationStrategy: PID 24330 died... 07:47:22.996180 run iperf3-srv_10.42.42.10(pid=24330): Terminated {rc=256} 07:47:23.039372 --- ParallelTerminationStrategy: PID 24331 died... 07:47:23.057904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24331): Terminated: ok {rc=0} 07:47:23.101394 --- ParallelTerminationStrategy: PID 24332 died... 07:47:23.119950 run iperf3-srv_10.42.42.10(pid=24332): Terminated {rc=256} 07:47:23.163085 --- ParallelTerminationStrategy: PID 24335 died... 07:47:23.181622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24335): Terminated: ok {rc=0} 07:47:23.224798 --- ParallelTerminationStrategy: PID 24338 died... 07:47:23.243732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24338): Terminated: ok {rc=0} 07:47:23.287394 --- ParallelTerminationStrategy: PID 24341 died... 07:47:23.305959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24341): Terminated: ok {rc=0} 07:47:23.391202 bus /gobi_4: Setting Powered False 07:47:24.492739 bus /gobi_4: Setting Powered False 07:47:25.604504 bus /gobi_1: Setting Powered False 07:47:26.702563 bus /gobi_1: Setting Powered False 07:47:27.819301 bus /gobi_0: Setting Powered False 07:47:28.916929 bus /gobi_0: Setting Powered False 07:47:30.033955 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 07:47:31.134821 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:31.147893 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:47:31.206077 tst ping.py: using LAC 39450 07:47:31.369097 tst ping.py: using RAC 180 07:47:31.508034 tst ping.py: using CellId 39450 07:47:31.636425 tst ping.py: using BVCI 39451 07:47:31.794761 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:31.809850 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:31.824437 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:31.838527 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:31.851792 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:31.865048 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:31.878489 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:31.890898 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:47:32.027844 tst ping.py:19: start network... 07:47:32.237362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:32.701354 run create_hlr_db(pid=24343): Launched 07:47:32.825087 bus /gobi_6: Setting Powered False 07:47:33.884576 run create_hlr_db(pid=24343): Terminated: ok {rc=0} 07:47:34.322241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24345): Launched 07:47:34.645458 run osmo-hlr_10.42.42.2(pid=24346): Launched 07:47:34.771883 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:35.335102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24348): Launched 07:47:35.657002 run osmo-stp_10.42.42.5(pid=24349): Launched 07:47:35.782723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:36.335951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24351): Launched 07:47:36.462127 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:36.733311 run patchelf(pid=24352): Launched 07:47:36.914084 run osmo-stp_10.42.42.5(pid=24349): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24349)] 07:47:37.050262 run osmo-stp_10.42.42.5(pid=24349): stdout: | (launched: 2022-12-14_07:47:35.598143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:37.187768 run osmo-stp_10.42.42.5(pid=24349): stderr: | 20221214074735787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074735787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074735787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074735788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074735788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074735788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074735788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:37.325586 run osmo-stp_10.42.42.5(pid=24349): stdout: | (launched: 2022-12-14_07:47:35.598143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:37.456877 run osmo-stp_10.42.42.5(pid=24349): stderr: | 20221214074735787 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074735787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074735787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074735788 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074735788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074735788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074735788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:37.612506 run patchelf(pid=24352): Terminating (SIGINT) 07:47:37.793826 run patchelf(pid=24352): Terminated: ok {rc=0} 07:47:37.924680 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24349): Process ended prematurely: osmo-stp_10.42.42.5(pid=24349) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24349)] [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 07:47:37.934395 tst ping.py:22: Test FAILED (6.8 sec) 07:47:37.962668 run osmo-hlr_10.42.42.2(pid=24346): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24346)] 07:47:38.012804 run osmo-hlr_10.42.42.2(pid=24346): stdout: | (launched: 2022-12-14_07:47:34.586697) 07:47:38.064649 run osmo-hlr_10.42.42.2(pid=24346): stderr: | 20221214074734781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074734781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074734781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074734781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074734782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074734782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074734818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074734828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074734828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074734828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:38.117201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24345): Terminating (SIGTERM) 07:47:38.158680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24348): Terminating (SIGTERM) 07:47:38.200437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24351): Terminating (SIGTERM) 07:47:38.242697 --- ParallelTerminationStrategy: PID 24345 died... 07:47:38.263173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24345): Terminated: ok {rc=0} 07:47:38.309560 --- ParallelTerminationStrategy: PID 24348 died... 07:47:38.329585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24348): Terminated: ok {rc=0} 07:47:38.375895 --- ParallelTerminationStrategy: PID 24351 died... 07:47:38.396011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24351): Terminated: ok {rc=0} 07:47:38.485265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:47:39.572022 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:39.584529 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:47:39.639152 tst ping_idle_ping.py: using LAC 39451 07:47:39.767209 tst ping_idle_ping.py: using RAC 181 07:47:39.894833 tst ping_idle_ping.py: using CellId 39451 07:47:40.023383 tst ping_idle_ping.py: using BVCI 39452 07:47:40.140514 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:40.152157 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:40.163287 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:40.174608 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:40.186121 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:40.197682 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:40.209577 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:47:40.221008 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:47:40.337970 tst ping_idle_ping.py:24: start network... 07:47:40.539947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:41.007621 run create_hlr_db(pid=24353): Launched 07:47:41.131165 bus /gobi_6: Setting Powered False 07:47:42.191241 run create_hlr_db(pid=24353): Terminated: ok {rc=0} 07:47:42.633543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24355): Launched 07:47:42.958948 run osmo-hlr_10.42.42.2(pid=24356): Launched 07:47:43.084177 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:43.645307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24358): Launched 07:47:43.968714 run osmo-stp_10.42.42.5(pid=24359): Launched 07:47:44.092101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:44.648554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24361): Launched 07:47:44.774553 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:45.047667 run patchelf(pid=24362): Launched 07:47:45.229229 run osmo-stp_10.42.42.5(pid=24359): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24359)] 07:47:45.365916 run osmo-stp_10.42.42.5(pid=24359): stdout: | (launched: 2022-12-14_07:47:43.909470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:45.503618 run osmo-stp_10.42.42.5(pid=24359): stderr: | 20221214074744097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074744097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074744097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074744097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074744098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074744098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074744098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:45.642095 run osmo-stp_10.42.42.5(pid=24359): stdout: | (launched: 2022-12-14_07:47:43.909470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:45.773738 run osmo-stp_10.42.42.5(pid=24359): stderr: | 20221214074744097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074744097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074744097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074744097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074744098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074744098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074744098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:45.937367 run patchelf(pid=24362): Terminating (SIGINT) 07:47:46.113483 run patchelf(pid=24362): Terminated: ok {rc=0} 07:47:46.241814 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24359): Process ended prematurely: osmo-stp_10.42.42.5(pid=24359) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24359)] [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 07:47:46.251802 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:47:46.280278 run osmo-hlr_10.42.42.2(pid=24356): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24356)] 07:47:46.332406 run osmo-hlr_10.42.42.2(pid=24356): stdout: | (launched: 2022-12-14_07:47:42.899060) 07:47:46.385500 run osmo-hlr_10.42.42.2(pid=24356): stderr: | 20221214074743093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074743093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074743093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074743093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074743093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074743093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074743109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074743118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074743119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074743119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:46.439025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24355): Terminating (SIGTERM) 07:47:46.481019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24358): Terminating (SIGTERM) 07:47:46.525510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24361): Terminating (SIGTERM) 07:47:46.571319 --- ParallelTerminationStrategy: PID 24355 died... 07:47:46.592576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24355): Terminated: ok {rc=0} 07:47:46.642049 --- ParallelTerminationStrategy: PID 24358 died... 07:47:46.663025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24358): Terminated: ok {rc=0} 07:47:46.710677 --- ParallelTerminationStrategy: PID 24361 died... 07:47:46.731357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24361): Terminated: ok {rc=0} 07:47:46.820609 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:47:48.122730 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:47:48.129183 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:47:48.162353 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:47:48.202143 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:47:48.288863 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:47:48.321749 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:47:48.359692 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:47:48.951502 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:47:49.000809 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:47:49.011773 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:47:49.082147 tst cs_paging_gprs_active.py: using LAC 39452 07:47:49.204804 tst cs_paging_gprs_active.py: using RAC 182 07:47:49.329794 tst cs_paging_gprs_active.py: using CellId 39452 07:47:49.450734 tst cs_paging_gprs_active.py: using BVCI 39453 07:47:49.563877 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:47:49.574834 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:47:49.585558 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:47:49.596199 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:47:49.606807 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:47:49.617529 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:47:49.628270 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:47:49.638821 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:47:49.649607 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:47:49.772133 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:47:49.895123 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:47:50.118698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:50.449360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24368): Launched 07:47:50.737574 run iperf3-srv_10.42.42.10(pid=24369): Launched 07:47:50.862755 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:47:51.087091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:47:51.420383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24370): Launched 07:47:51.709551 run iperf3-srv_10.42.42.10(pid=24371): Launched 07:47:51.835051 tst cs_paging_gprs_active.py:38: start network... 07:47:52.057367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:52.566581 run create_hlr_db(pid=24372): Launched 07:47:52.695607 bus /gobi_6: Setting Powered False 07:47:53.761132 run create_hlr_db(pid=24372): Terminated: ok {rc=0} 07:47:54.199462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24374): Launched 07:47:54.530655 run osmo-hlr_10.42.42.2(pid=24375): Launched 07:47:54.658766 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:55.227308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24377): Launched 07:47:55.558058 run osmo-stp_10.42.42.5(pid=24378): Launched 07:47:55.685235 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:47:56.250694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24380): Launched 07:47:56.376519 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:47:56.661848 run patchelf(pid=24381): Launched 07:47:56.846441 run osmo-stp_10.42.42.5(pid=24378): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24378)] 07:47:56.986867 run osmo-stp_10.42.42.5(pid=24378): stdout: | (launched: 2022-12-14_07:47:55.497909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:57.128041 run osmo-stp_10.42.42.5(pid=24378): stderr: | 20221214074755686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074755686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074755688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074755688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074755689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074755689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074755689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:57.268531 run osmo-stp_10.42.42.5(pid=24378): stdout: | (launched: 2022-12-14_07:47:55.497909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:57.404159 run osmo-stp_10.42.42.5(pid=24378): stderr: | 20221214074755686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074755686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074755688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074755688 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074755689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074755689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074755689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:57.564234 run patchelf(pid=24381): Terminating (SIGINT) 07:47:57.750682 run patchelf(pid=24381): Terminated: ok {rc=0} 07:47:57.885305 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24378): Process ended prematurely: osmo-stp_10.42.42.5(pid=24378) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24378)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:47:57.895397 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 07:47:57.924263 run osmo-hlr_10.42.42.2(pid=24375): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24375)] 07:47:57.974569 run osmo-hlr_10.42.42.2(pid=24375): stdout: | (launched: 2022-12-14_07:47:54.470386) 07:47:58.026946 run osmo-hlr_10.42.42.2(pid=24375): stderr: | 20221214074754665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074754665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074754665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074754665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074754665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074754665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074754677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074754686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074754686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074754686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:58.079284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24368): Terminating (SIGTERM) 07:47:58.121055 run iperf3-srv_10.42.42.10(pid=24369): Terminating (SIGTERM) 07:47:58.163288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24370): Terminating (SIGTERM) 07:47:58.205434 run iperf3-srv_10.42.42.10(pid=24371): Terminating (SIGTERM) 07:47:58.247043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24374): Terminating (SIGTERM) 07:47:58.289112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24377): Terminating (SIGTERM) 07:47:58.330885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24380): Terminating (SIGTERM) 07:47:58.373081 --- ParallelTerminationStrategy: PID 24368 died... 07:47:58.393584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24368): Terminated: ok {rc=0} 07:47:58.439824 --- ParallelTerminationStrategy: PID 24369 died... 07:47:58.459677 run iperf3-srv_10.42.42.10(pid=24369): Terminated {rc=256} 07:47:58.505893 --- ParallelTerminationStrategy: PID 24370 died... 07:47:58.525860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24370): Terminated: ok {rc=0} 07:47:58.572147 --- ParallelTerminationStrategy: PID 24371 died... 07:47:58.592052 run iperf3-srv_10.42.42.10(pid=24371): Terminated {rc=256} 07:47:58.638873 --- ParallelTerminationStrategy: PID 24374 died... 07:47:58.658732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24374): Terminated: ok {rc=0} 07:47:58.704582 --- ParallelTerminationStrategy: PID 24377 died... 07:47:58.724499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24377): Terminated: ok {rc=0} 07:47:58.770549 --- ParallelTerminationStrategy: PID 24380 died... 07:47:58.790297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24380): Terminated: ok {rc=0} 07:47:58.878401 bus /gobi_0: Setting Powered False 07:47:59.981637 bus /gobi_0: Setting Powered False 07:48:01.096293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:48:02.254086 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:02.266525 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:48:02.339317 tst iperf3.py: using LAC 39453 07:48:02.469547 tst iperf3.py: using RAC 183 07:48:02.598484 tst iperf3.py: using CellId 39453 07:48:02.726838 tst iperf3.py: using BVCI 39454 07:48:02.847883 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:02.859248 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:02.870596 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:02.881941 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:02.893648 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:02.905348 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:02.917501 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:02.928832 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:02.940515 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:48:03.061461 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:48:03.282983 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:48:03.611870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24382): Launched 07:48:03.900072 run iperf3-srv_10.42.42.10(pid=24383): Launched 07:48:04.025702 tst iperf3.py:8: start network... 07:48:04.246404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:04.753943 run create_hlr_db(pid=24384): Launched 07:48:04.880337 bus /gobi_6: Setting Powered False 07:48:05.945564 run create_hlr_db(pid=24384): Terminated: ok {rc=0} 07:48:06.382124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24386): Launched 07:48:06.688608 run osmo-hlr_10.42.42.2(pid=24387): Launched 07:48:06.805108 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:07.330383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24389): Launched 07:48:07.636216 run osmo-stp_10.42.42.5(pid=24390): Launched 07:48:07.752162 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:48:08.277259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24392): Launched 07:48:08.394274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:48:08.652024 run patchelf(pid=24393): Launched 07:48:08.823216 run osmo-stp_10.42.42.5(pid=24390): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24390)] 07:48:08.952023 run osmo-stp_10.42.42.5(pid=24390): stdout: | (launched: 2022-12-14_07:48:07.580041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:09.082779 run osmo-stp_10.42.42.5(pid=24390): stderr: | 20221214074807749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074807749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074807749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074807750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074807750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074807750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074807750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:09.213123 run osmo-stp_10.42.42.5(pid=24390): stdout: | (launched: 2022-12-14_07:48:07.580041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:09.336892 run osmo-stp_10.42.42.5(pid=24390): stderr: | 20221214074807749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074807749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074807749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074807750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074807750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074807750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074807750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:09.484325 run patchelf(pid=24393): Terminating (SIGINT) 07:48:09.657078 run patchelf(pid=24393): Terminated: ok {rc=0} 07:48:09.781812 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24390): Process ended prematurely: osmo-stp_10.42.42.5(pid=24390) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24390)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 07:48:09.791149 tst iperf3.py:8: Test FAILED (7.6 sec) 07:48:09.818390 run osmo-hlr_10.42.42.2(pid=24387): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24387)] 07:48:09.865745 run osmo-hlr_10.42.42.2(pid=24387): stdout: | (launched: 2022-12-14_07:48:06.632073) 07:48:09.914785 run osmo-hlr_10.42.42.2(pid=24387): stderr: | 20221214074806809 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074806809 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074806809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074806809 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074806809 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074806809 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074806821 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074806830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074806830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074806830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:09.964456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24382): Terminating (SIGTERM) 07:48:10.004362 run iperf3-srv_10.42.42.10(pid=24383): Terminating (SIGTERM) 07:48:10.044031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24386): Terminating (SIGTERM) 07:48:10.083874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24389): Terminating (SIGTERM) 07:48:10.123571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24392): Terminating (SIGTERM) 07:48:10.163608 --- ParallelTerminationStrategy: PID 24382 died... 07:48:10.182799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24382): Terminated: ok {rc=0} 07:48:10.226587 --- ParallelTerminationStrategy: PID 24383 died... 07:48:10.245132 run iperf3-srv_10.42.42.10(pid=24383): Terminated {rc=256} 07:48:10.288422 --- ParallelTerminationStrategy: PID 24386 died... 07:48:10.306964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24386): Terminated: ok {rc=0} 07:48:10.350699 --- ParallelTerminationStrategy: PID 24389 died... 07:48:10.369216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24389): Terminated: ok {rc=0} 07:48:10.412453 --- ParallelTerminationStrategy: PID 24392 died... 07:48:10.430965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24392): Terminated: ok {rc=0} 07:48:10.516035 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:48:11.662832 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:11.674449 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:48:11.745888 tst iperf3m4.py: using LAC 39454 07:48:11.870583 tst iperf3m4.py: using RAC 184 07:48:11.990933 tst iperf3m4.py: using CellId 39454 07:48:12.108310 tst iperf3m4.py: using BVCI 39455 07:48:12.219936 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:12.231002 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:12.241956 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:12.252663 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:12.263428 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:12.274290 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:12.285194 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:12.295839 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:12.306850 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:48:12.428851 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:48:12.548833 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:48:12.670280 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:48:12.791327 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:48:13.013255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:48:13.341603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24394): Launched 07:48:13.629641 run iperf3-srv_10.42.42.10(pid=24395): Launched 07:48:13.754277 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:48:13.976912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:48:14.307812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24396): Launched 07:48:14.595842 run iperf3-srv_10.42.42.10(pid=24397): Launched 07:48:14.721383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:48:14.941477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:48:15.270293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24398): Launched 07:48:15.558056 run iperf3-srv_10.42.42.10(pid=24399): Launched 07:48:15.684028 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:48:15.911966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:48:16.249880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24400): Launched 07:48:16.551421 run iperf3-srv_10.42.42.10(pid=24401): Launched 07:48:16.692377 tst iperf3m4.py:8: start network... 07:48:16.920192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:17.439894 run create_hlr_db(pid=24402): Launched 07:48:17.567168 bus /gobi_6: Setting Powered False 07:48:18.627960 run create_hlr_db(pid=24402): Terminated: ok {rc=0} 07:48:19.053674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Launched 07:48:19.360552 run osmo-hlr_10.42.42.2(pid=24405): Launched 07:48:19.475841 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:20.003199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Launched 07:48:20.309264 run osmo-stp_10.42.42.5(pid=24408): Launched 07:48:20.426176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:48:20.952875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24410): Launched 07:48:21.070160 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:48:21.327442 run patchelf(pid=24411): Launched 07:48:21.498109 run osmo-stp_10.42.42.5(pid=24408): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24408)] 07:48:21.626634 run osmo-stp_10.42.42.5(pid=24408): stdout: | (launched: 2022-12-14_07:48:20.252648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:21.756668 run osmo-stp_10.42.42.5(pid=24408): stderr: | 20221214074820419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074820419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074820420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074820420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074820421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074820421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074820421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:21.886858 run osmo-stp_10.42.42.5(pid=24408): stdout: | (launched: 2022-12-14_07:48:20.252648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:22.011011 run osmo-stp_10.42.42.5(pid=24408): stderr: | 20221214074820419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074820419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074820420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074820420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074820421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074820421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074820421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:22.157954 run patchelf(pid=24411): Terminating (SIGINT) 07:48:22.330409 run patchelf(pid=24411): Terminated: ok {rc=0} 07:48:22.455312 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24408): Process ended prematurely: osmo-stp_10.42.42.5(pid=24408) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24408)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:48:22.464605 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:48:22.491880 run osmo-hlr_10.42.42.2(pid=24405): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24405)] 07:48:22.539284 run osmo-hlr_10.42.42.2(pid=24405): stdout: | (launched: 2022-12-14_07:48:19.304123) 07:48:22.588803 run osmo-hlr_10.42.42.2(pid=24405): stderr: | 20221214074819475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074819475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074819475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074819475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074819475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074819475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074819487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074819495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074819495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074819496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:22.638060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24394): Terminating (SIGTERM) 07:48:22.677805 run iperf3-srv_10.42.42.10(pid=24395): Terminating (SIGTERM) 07:48:22.717854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24396): Terminating (SIGTERM) 07:48:22.757714 run iperf3-srv_10.42.42.10(pid=24397): Terminating (SIGTERM) 07:48:22.797109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24398): Terminating (SIGTERM) 07:48:22.836576 run iperf3-srv_10.42.42.10(pid=24399): Terminating (SIGTERM) 07:48:22.875912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24400): Terminating (SIGTERM) 07:48:22.915433 run iperf3-srv_10.42.42.10(pid=24401): Terminating (SIGTERM) 07:48:22.954681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Terminating (SIGTERM) 07:48:22.994241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Terminating (SIGTERM) 07:48:23.033849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24410): Terminating (SIGTERM) 07:48:23.073643 --- ParallelTerminationStrategy: PID 24394 died... 07:48:23.092763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24394): Terminated: ok {rc=0} 07:48:23.136726 --- ParallelTerminationStrategy: PID 24395 died... 07:48:23.155432 run iperf3-srv_10.42.42.10(pid=24395): Terminated {rc=256} 07:48:23.199171 --- ParallelTerminationStrategy: PID 24396 died... 07:48:23.217827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24396): Terminated: ok {rc=0} 07:48:23.261351 --- ParallelTerminationStrategy: PID 24397 died... 07:48:23.279705 run iperf3-srv_10.42.42.10(pid=24397): Terminated {rc=256} 07:48:23.323519 --- ParallelTerminationStrategy: PID 24398 died... 07:48:23.342082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24398): Terminated: ok {rc=0} 07:48:23.385864 --- ParallelTerminationStrategy: PID 24399 died... 07:48:23.404338 run iperf3-srv_10.42.42.10(pid=24399): Terminated {rc=256} 07:48:23.447827 --- ParallelTerminationStrategy: PID 24400 died... 07:48:23.466322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24400): Terminated: ok {rc=0} 07:48:23.509823 --- ParallelTerminationStrategy: PID 24401 died... 07:48:23.528473 run iperf3-srv_10.42.42.10(pid=24401): Terminated {rc=256} 07:48:23.572341 --- ParallelTerminationStrategy: PID 24404 died... 07:48:23.590894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Terminated: ok {rc=0} 07:48:23.634243 --- ParallelTerminationStrategy: PID 24407 died... 07:48:23.652528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Terminated: ok {rc=0} 07:48:23.696038 --- ParallelTerminationStrategy: PID 24410 died... 07:48:23.714675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24410): Terminated: ok {rc=0} 07:48:23.800277 bus /gobi_4: Setting Powered False 07:48:24.900430 bus /gobi_4: Setting Powered False 07:48:26.017501 bus /gobi_1: Setting Powered False 07:48:27.114991 bus /gobi_1: Setting Powered False 07:48:28.231489 bus /gobi_0: Setting Powered False 07:48:29.329113 bus /gobi_0: Setting Powered False 07:48:30.445493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:48:31.546913 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:31.559828 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:48:31.631948 tst ping.py: using LAC 39455 07:48:31.763234 tst ping.py: using RAC 185 07:48:31.909500 tst ping.py: using CellId 39455 07:48:32.035780 tst ping.py: using BVCI 39456 07:48:32.185846 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:32.199499 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:32.210959 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:32.224467 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:32.235909 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:32.247143 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:32.258470 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:32.270202 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:48:32.384771 tst ping.py:19: start network... 07:48:32.584473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:33.048202 run create_hlr_db(pid=24412): Launched 07:48:33.172217 bus /gobi_6: Setting Powered False 07:48:34.232930 run create_hlr_db(pid=24412): Terminated: ok {rc=0} 07:48:34.672100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Launched 07:48:34.996086 run osmo-hlr_10.42.42.2(pid=24415): Launched 07:48:35.120584 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:35.684390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Launched 07:48:36.009257 run osmo-stp_10.42.42.5(pid=24418): Launched 07:48:36.132113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:48:36.686272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24420): Launched 07:48:36.810083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:48:37.082810 run patchelf(pid=24421): Launched 07:48:37.263457 run osmo-stp_10.42.42.5(pid=24418): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] 07:48:37.399859 run osmo-stp_10.42.42.5(pid=24418): stdout: | (launched: 2022-12-14_07:48:35.949279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:37.537821 run osmo-stp_10.42.42.5(pid=24418): stderr: | 20221214074836139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074836139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074836140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074836140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074836141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074836141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074836141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:37.675800 run osmo-stp_10.42.42.5(pid=24418): stdout: | (launched: 2022-12-14_07:48:35.949279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:37.807182 run osmo-stp_10.42.42.5(pid=24418): stderr: | 20221214074836139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074836139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074836140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074836140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074836141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074836141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074836141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:37.963216 run patchelf(pid=24421): Terminating (SIGINT) 07:48:38.144630 run patchelf(pid=24421): Terminated: ok {rc=0} 07:48:38.275360 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24418): Process ended prematurely: osmo-stp_10.42.42.5(pid=24418) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 07:48:38.284848 tst ping.py:22: Test FAILED (6.7 sec) 07:48:38.313260 run osmo-hlr_10.42.42.2(pid=24415): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24415)] 07:48:38.363846 run osmo-hlr_10.42.42.2(pid=24415): stdout: | (launched: 2022-12-14_07:48:34.936525) 07:48:38.416202 run osmo-hlr_10.42.42.2(pid=24415): stderr: | 20221214074835131 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074835131 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074835131 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074835131 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074835131 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074835131 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074835143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074835154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074835154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074835154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:38.468591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Terminating (SIGTERM) 07:48:38.510275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Terminating (SIGTERM) 07:48:38.552194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24420): Terminating (SIGTERM) 07:48:38.594607 --- ParallelTerminationStrategy: PID 24414 died... 07:48:38.615266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24414): Terminated: ok {rc=0} 07:48:38.661933 --- ParallelTerminationStrategy: PID 24417 died... 07:48:38.681926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24417): Terminated: ok {rc=0} 07:48:38.728274 --- ParallelTerminationStrategy: PID 24420 died... 07:48:38.748158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24420): Terminated: ok {rc=0} 07:48:38.837108 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:48:39.924703 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:39.937721 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:48:40.011230 tst ping_idle_ping.py: using LAC 39456 07:48:40.139953 tst ping_idle_ping.py: using RAC 186 07:48:40.266157 tst ping_idle_ping.py: using CellId 39456 07:48:40.397811 tst ping_idle_ping.py: using BVCI 39457 07:48:40.516778 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:40.528328 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:40.539525 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:40.550766 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:40.562596 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:40.574329 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:40.586161 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:48:40.597816 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:48:40.715651 tst ping_idle_ping.py:24: start network... 07:48:40.918821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:41.387559 run create_hlr_db(pid=24422): Launched 07:48:41.511733 bus /gobi_6: Setting Powered False 07:48:42.571556 run create_hlr_db(pid=24422): Terminated: ok {rc=0} 07:48:43.014317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24424): Launched 07:48:43.338722 run osmo-hlr_10.42.42.2(pid=24425): Launched 07:48:43.462396 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:44.021095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24427): Launched 07:48:44.345085 run osmo-stp_10.42.42.5(pid=24428): Launched 07:48:44.470373 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:48:45.030798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24430): Launched 07:48:45.156064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:48:45.430275 run patchelf(pid=24431): Launched 07:48:45.611468 run osmo-stp_10.42.42.5(pid=24428): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24428)] 07:48:45.749076 run osmo-stp_10.42.42.5(pid=24428): stdout: | (launched: 2022-12-14_07:48:44.285578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:45.895576 run osmo-stp_10.42.42.5(pid=24428): stderr: | 20221214074844475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074844475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074844475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074844475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074844476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074844476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074844476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:46.042783 run osmo-stp_10.42.42.5(pid=24428): stdout: | (launched: 2022-12-14_07:48:44.285578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:46.169848 run osmo-stp_10.42.42.5(pid=24428): stderr: | 20221214074844475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074844475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074844475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074844475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074844476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074844476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074844476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:46.319589 run patchelf(pid=24431): Terminating (SIGINT) 07:48:46.495359 run patchelf(pid=24431): Terminated: ok {rc=0} 07:48:46.622699 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24428): Process ended prematurely: osmo-stp_10.42.42.5(pid=24428) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24428)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:48:46.632589 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:48:46.661175 run osmo-hlr_10.42.42.2(pid=24425): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24425)] 07:48:46.711523 run osmo-hlr_10.42.42.2(pid=24425): stdout: | (launched: 2022-12-14_07:48:43.278977) 07:48:46.764679 run osmo-hlr_10.42.42.2(pid=24425): stderr: | 20221214074843475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074843475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074843475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074843475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074843475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074843475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074843488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074843497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074843497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074843498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:46.816068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24424): Terminating (SIGTERM) 07:48:46.857377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24427): Terminating (SIGTERM) 07:48:46.901290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24430): Terminating (SIGTERM) 07:48:46.945730 --- ParallelTerminationStrategy: PID 24424 died... 07:48:46.967043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24424): Terminated: ok {rc=0} 07:48:47.013392 --- ParallelTerminationStrategy: PID 24427 died... 07:48:47.032600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24427): Terminated: ok {rc=0} 07:48:47.077571 --- ParallelTerminationStrategy: PID 24430 died... 07:48:47.096605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24430): Terminated: ok {rc=0} 07:48:47.183865 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:48:48.490636 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:48:48.497409 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:48:48.531614 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:48:48.572709 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:48:48.661917 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:48:48.695217 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:48:48.734266 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:48:49.330909 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:48:49.383982 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:48:49.395305 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:48:49.467254 tst cs_paging_gprs_active.py: using LAC 39457 07:48:49.598783 tst cs_paging_gprs_active.py: using RAC 187 07:48:49.727623 tst cs_paging_gprs_active.py: using CellId 39457 07:48:49.850157 tst cs_paging_gprs_active.py: using BVCI 39458 07:48:49.964363 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:48:49.975479 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:48:49.986425 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:48:49.997272 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:48:50.008768 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:48:50.020208 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:48:50.031691 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:48:50.042976 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:48:50.054494 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:48:50.177591 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:48:50.305092 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:48:50.527678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:48:50.857765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24438): Launched 07:48:51.146628 run iperf3-srv_10.42.42.10(pid=24439): Launched 07:48:51.272174 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:48:51.493858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:48:51.823950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24440): Launched 07:48:52.112338 run iperf3-srv_10.42.42.10(pid=24441): Launched 07:48:52.235644 tst cs_paging_gprs_active.py:38: start network... 07:48:52.457192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:52.966134 run create_hlr_db(pid=24442): Launched 07:48:53.094574 bus /gobi_6: Setting Powered False 07:48:54.159162 run create_hlr_db(pid=24442): Terminated: ok {rc=0} 07:48:54.595050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24444): Launched 07:48:54.901460 run osmo-hlr_10.42.42.2(pid=24445): Launched 07:48:55.019149 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:55.548865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24447): Launched 07:48:55.855975 run osmo-stp_10.42.42.5(pid=24448): Launched 07:48:55.973219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:48:56.503552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24450): Launched 07:48:56.622287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:48:56.882585 run patchelf(pid=24451): Launched 07:48:57.056072 run osmo-stp_10.42.42.5(pid=24448): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24448)] 07:48:57.186252 run osmo-stp_10.42.42.5(pid=24448): stdout: | (launched: 2022-12-14_07:48:55.799293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:57.316647 run osmo-stp_10.42.42.5(pid=24448): stderr: | 20221214074855967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074855967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074855968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074855968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074855969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074855969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074855969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:57.447137 run osmo-stp_10.42.42.5(pid=24448): stdout: | (launched: 2022-12-14_07:48:55.799293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:57.572207 run osmo-stp_10.42.42.5(pid=24448): stderr: | 20221214074855967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074855967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074855968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074855968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074855969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074855969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074855969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:57.720325 run patchelf(pid=24451): Terminating (SIGINT) 07:48:57.894083 run patchelf(pid=24451): Terminated: ok {rc=0} 07:48:58.019251 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24448): Process ended prematurely: osmo-stp_10.42.42.5(pid=24448) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24448)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:48:58.028594 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:48:58.055774 run osmo-hlr_10.42.42.2(pid=24445): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24445)] 07:48:58.102992 run osmo-hlr_10.42.42.2(pid=24445): stdout: | (launched: 2022-12-14_07:48:54.845124) 07:48:58.152102 run osmo-hlr_10.42.42.2(pid=24445): stderr: | 20221214074855019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074855019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074855019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074855019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074855019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074855019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074855032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074855040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074855040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074855040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:58.201597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24438): Terminating (SIGTERM) 07:48:58.240920 run iperf3-srv_10.42.42.10(pid=24439): Terminating (SIGTERM) 07:48:58.280018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24440): Terminating (SIGTERM) 07:48:58.319997 run iperf3-srv_10.42.42.10(pid=24441): Terminating (SIGTERM) 07:48:58.359051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24444): Terminating (SIGTERM) 07:48:58.398442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24447): Terminating (SIGTERM) 07:48:58.437589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24450): Terminating (SIGTERM) 07:48:58.477106 --- ParallelTerminationStrategy: PID 24438 died... 07:48:58.495934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24438): Terminated: ok {rc=0} 07:48:58.539210 --- ParallelTerminationStrategy: PID 24439 died... 07:48:58.557591 run iperf3-srv_10.42.42.10(pid=24439): Terminated {rc=256} 07:48:58.600789 --- ParallelTerminationStrategy: PID 24440 died... 07:48:58.619377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24440): Terminated: ok {rc=0} 07:48:58.662645 --- ParallelTerminationStrategy: PID 24441 died... 07:48:58.681482 run iperf3-srv_10.42.42.10(pid=24441): Terminated {rc=256} 07:48:58.724611 --- ParallelTerminationStrategy: PID 24444 died... 07:48:58.743069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24444): Terminated: ok {rc=0} 07:48:58.786220 --- ParallelTerminationStrategy: PID 24447 died... 07:48:58.804603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24447): Terminated: ok {rc=0} 07:48:58.847878 --- ParallelTerminationStrategy: PID 24450 died... 07:48:58.866311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24450): Terminated: ok {rc=0} 07:48:58.951780 bus /gobi_0: Setting Powered False 07:49:00.050392 bus /gobi_0: Setting Powered False 07:49:01.163561 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:49:02.317130 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:02.329458 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:49:02.401632 tst iperf3.py: using LAC 39458 07:49:02.521593 tst iperf3.py: using RAC 188 07:49:02.640395 tst iperf3.py: using CellId 39458 07:49:02.760879 tst iperf3.py: using BVCI 39459 07:49:02.871959 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:02.882789 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:02.893554 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:02.904124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:02.914681 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:02.925414 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:02.936099 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:02.946694 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:02.957472 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:49:03.078501 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:49:03.301404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:49:03.631494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24452): Launched 07:49:03.921336 run iperf3-srv_10.42.42.10(pid=24453): Launched 07:49:04.047576 tst iperf3.py:8: start network... 07:49:04.269541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:04.779740 run create_hlr_db(pid=24454): Launched 07:49:04.908569 bus /gobi_6: Setting Powered False 07:49:05.974198 run create_hlr_db(pid=24454): Terminated: ok {rc=0} 07:49:06.413968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24456): Launched 07:49:06.722149 run osmo-hlr_10.42.42.2(pid=24457): Launched 07:49:06.839345 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:07.373858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24459): Launched 07:49:07.683514 run osmo-stp_10.42.42.5(pid=24460): Launched 07:49:07.802700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:49:08.331474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24462): Launched 07:49:08.449233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:49:08.707791 run patchelf(pid=24463): Launched 07:49:08.880789 run osmo-stp_10.42.42.5(pid=24460): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24460)] 07:49:09.009941 run osmo-stp_10.42.42.5(pid=24460): stdout: | (launched: 2022-12-14_07:49:07.626409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:09.142191 run osmo-stp_10.42.42.5(pid=24460): stderr: | 20221214074907798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074907798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074907799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074907799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074907800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074907800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074907800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:09.272689 run osmo-stp_10.42.42.5(pid=24460): stdout: | (launched: 2022-12-14_07:49:07.626409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:09.396630 run osmo-stp_10.42.42.5(pid=24460): stderr: | 20221214074907798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074907798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074907799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074907799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074907800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074907800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074907800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:09.543804 run patchelf(pid=24463): Terminating (SIGINT) 07:49:09.716699 run patchelf(pid=24463): Terminated: ok {rc=0} 07:49:09.841602 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24460): Process ended prematurely: osmo-stp_10.42.42.5(pid=24460) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24460)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 07:49:09.850852 tst iperf3.py:8: Test FAILED (7.6 sec) 07:49:09.877942 run osmo-hlr_10.42.42.2(pid=24457): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24457)] 07:49:09.924762 run osmo-hlr_10.42.42.2(pid=24457): stdout: | (launched: 2022-12-14_07:49:06.665477) 07:49:09.973836 run osmo-hlr_10.42.42.2(pid=24457): stderr: | 20221214074906841 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074906841 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074906841 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074906841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074906841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074906842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074906854 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074906862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074906862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074906862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:10.022979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24452): Terminating (SIGTERM) 07:49:10.062314 run iperf3-srv_10.42.42.10(pid=24453): Terminating (SIGTERM) 07:49:10.101525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24456): Terminating (SIGTERM) 07:49:10.140618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24459): Terminating (SIGTERM) 07:49:10.179823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24462): Terminating (SIGTERM) 07:49:10.219444 --- ParallelTerminationStrategy: PID 24452 died... 07:49:10.238403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24452): Terminated: ok {rc=0} 07:49:10.282048 --- ParallelTerminationStrategy: PID 24453 died... 07:49:10.300303 run iperf3-srv_10.42.42.10(pid=24453): Terminated {rc=256} 07:49:10.343916 --- ParallelTerminationStrategy: PID 24456 died... 07:49:10.362573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24456): Terminated: ok {rc=0} 07:49:10.406107 --- ParallelTerminationStrategy: PID 24459 died... 07:49:10.424596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24459): Terminated: ok {rc=0} 07:49:10.467923 --- ParallelTerminationStrategy: PID 24462 died... 07:49:10.486481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24462): Terminated: ok {rc=0} 07:49:10.572670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:49:11.726089 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:11.738410 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:49:11.814197 tst iperf3m4.py: using LAC 39459 07:49:11.934375 tst iperf3m4.py: using RAC 189 07:49:12.053842 tst iperf3m4.py: using CellId 39459 07:49:12.173072 tst iperf3m4.py: using BVCI 39460 07:49:12.283658 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:12.294677 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:12.305684 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:12.316309 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:12.327065 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:12.337832 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:12.348711 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:12.359304 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:12.370155 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:49:12.493638 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:49:12.618514 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:49:12.737317 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:49:12.854560 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:49:13.061201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:49:13.371429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24464): Launched 07:49:13.640809 run iperf3-srv_10.42.42.10(pid=24465): Launched 07:49:13.756830 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:49:13.962008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:49:14.270977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24466): Launched 07:49:14.540130 run iperf3-srv_10.42.42.10(pid=24467): Launched 07:49:14.656048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:49:14.861190 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:49:15.170351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24468): Launched 07:49:15.441225 run iperf3-srv_10.42.42.10(pid=24469): Launched 07:49:15.556514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:49:15.761087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:49:16.157794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24470): Launched 07:49:16.443989 run iperf3-srv_10.42.42.10(pid=24471): Launched 07:49:16.575956 tst iperf3m4.py:8: start network... 07:49:16.785374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:17.269694 run create_hlr_db(pid=24472): Launched 07:49:17.395932 bus /gobi_6: Setting Powered False 07:49:18.456733 run create_hlr_db(pid=24472): Terminated: ok {rc=0} 07:49:18.905927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24474): Launched 07:49:19.247066 run osmo-hlr_10.42.42.2(pid=24475): Launched 07:49:19.373954 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:19.946323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24477): Launched 07:49:20.277681 run osmo-stp_10.42.42.5(pid=24478): Launched 07:49:20.405858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:49:20.975459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24480): Launched 07:49:21.102391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:49:21.380692 run patchelf(pid=24481): Launched 07:49:21.563486 run osmo-stp_10.42.42.5(pid=24478): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24478)] 07:49:21.701991 run osmo-stp_10.42.42.5(pid=24478): stdout: | (launched: 2022-12-14_07:49:20.217395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:21.842188 run osmo-stp_10.42.42.5(pid=24478): stderr: | 20221214074920407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074920407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074920407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074920408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074920408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074920408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074920408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:21.983119 run osmo-stp_10.42.42.5(pid=24478): stdout: | (launched: 2022-12-14_07:49:20.217395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:22.117300 run osmo-stp_10.42.42.5(pid=24478): stderr: | 20221214074920407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074920407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074920407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074920408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074920408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074920408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074920408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:22.276138 run patchelf(pid=24481): Terminating (SIGINT) 07:49:22.461465 run patchelf(pid=24481): Terminated: ok {rc=0} 07:49:22.594892 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24478): Process ended prematurely: osmo-stp_10.42.42.5(pid=24478) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24478)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:49:22.605106 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:49:22.634069 run osmo-hlr_10.42.42.2(pid=24475): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24475)] 07:49:22.684414 run osmo-hlr_10.42.42.2(pid=24475): stdout: | (launched: 2022-12-14_07:49:19.186522) 07:49:22.736405 run osmo-hlr_10.42.42.2(pid=24475): stderr: | 20221214074919381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074919381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074919381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074919381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074919381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074919381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074919394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074919402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074919402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074919402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:22.789174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24464): Terminating (SIGTERM) 07:49:22.830774 run iperf3-srv_10.42.42.10(pid=24465): Terminating (SIGTERM) 07:49:22.872710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24466): Terminating (SIGTERM) 07:49:22.914921 run iperf3-srv_10.42.42.10(pid=24467): Terminating (SIGTERM) 07:49:22.956885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24468): Terminating (SIGTERM) 07:49:22.998814 run iperf3-srv_10.42.42.10(pid=24469): Terminating (SIGTERM) 07:49:23.040639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24470): Terminating (SIGTERM) 07:49:23.083093 run iperf3-srv_10.42.42.10(pid=24471): Terminating (SIGTERM) 07:49:23.124814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24474): Terminating (SIGTERM) 07:49:23.166820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24477): Terminating (SIGTERM) 07:49:23.208861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24480): Terminating (SIGTERM) 07:49:23.251248 --- ParallelTerminationStrategy: PID 24464 died... 07:49:23.271494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24464): Terminated: ok {rc=0} 07:49:23.318202 --- ParallelTerminationStrategy: PID 24465 died... 07:49:23.338099 run iperf3-srv_10.42.42.10(pid=24465): Terminated {rc=256} 07:49:23.383958 --- ParallelTerminationStrategy: PID 24466 died... 07:49:23.403862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24466): Terminated: ok {rc=0} 07:49:23.449934 --- ParallelTerminationStrategy: PID 24467 died... 07:49:23.469758 run iperf3-srv_10.42.42.10(pid=24467): Terminated {rc=256} 07:49:23.515680 --- ParallelTerminationStrategy: PID 24468 died... 07:49:23.535443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24468): Terminated: ok {rc=0} 07:49:23.581488 --- ParallelTerminationStrategy: PID 24469 died... 07:49:23.601218 run iperf3-srv_10.42.42.10(pid=24469): Terminated {rc=256} 07:49:23.647229 --- ParallelTerminationStrategy: PID 24470 died... 07:49:23.666997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24470): Terminated: ok {rc=0} 07:49:23.713310 --- ParallelTerminationStrategy: PID 24471 died... 07:49:23.732922 run iperf3-srv_10.42.42.10(pid=24471): Terminated {rc=256} 07:49:23.779111 --- ParallelTerminationStrategy: PID 24474 died... 07:49:23.798966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24474): Terminated: ok {rc=0} 07:49:23.845171 --- ParallelTerminationStrategy: PID 24477 died... 07:49:23.865045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24477): Terminated: ok {rc=0} 07:49:23.911180 --- ParallelTerminationStrategy: PID 24480 died... 07:49:23.931057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24480): Terminated: ok {rc=0} 07:49:24.019519 bus /gobi_4: Setting Powered False 07:49:25.118591 bus /gobi_4: Setting Powered False 07:49:26.238382 bus /gobi_1: Setting Powered False 07:49:27.336564 bus /gobi_1: Setting Powered False 07:49:28.451598 bus /gobi_0: Setting Powered False 07:49:29.548916 bus /gobi_0: Setting Powered False 07:49:30.662895 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:49:31.765347 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:31.777331 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:49:31.849946 tst ping.py: using LAC 39460 07:49:32.009470 tst ping.py: using RAC 190 07:49:32.174184 tst ping.py: using CellId 39460 07:49:32.302143 tst ping.py: using BVCI 39461 07:49:32.410817 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:32.422002 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:32.433271 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:32.444124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:32.454885 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:32.465795 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:32.476687 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:32.487548 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:49:32.603589 tst ping.py:19: start network... 07:49:32.806121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:33.272700 run create_hlr_db(pid=24482): Launched 07:49:33.396493 bus /gobi_6: Setting Powered False 07:49:34.457349 run create_hlr_db(pid=24482): Terminated: ok {rc=0} 07:49:34.900073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24484): Launched 07:49:35.226049 run osmo-hlr_10.42.42.2(pid=24485): Launched 07:49:35.351997 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:35.916491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24487): Launched 07:49:36.243752 run osmo-stp_10.42.42.5(pid=24488): Launched 07:49:36.369119 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:49:36.926952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24490): Launched 07:49:37.053771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:49:37.327460 run patchelf(pid=24491): Launched 07:49:37.508687 run osmo-stp_10.42.42.5(pid=24488): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24488)] 07:49:37.646171 run osmo-stp_10.42.42.5(pid=24488): stdout: | (launched: 2022-12-14_07:49:36.183919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:37.785149 run osmo-stp_10.42.42.5(pid=24488): stderr: | 20221214074936373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074936373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074936374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074936374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074936374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074936375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074936375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:37.923737 run osmo-stp_10.42.42.5(pid=24488): stdout: | (launched: 2022-12-14_07:49:36.183919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:38.056624 run osmo-stp_10.42.42.5(pid=24488): stderr: | 20221214074936373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074936373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074936374 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074936374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074936374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074936375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074936375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:38.213447 run patchelf(pid=24491): Terminating (SIGINT) 07:49:38.396571 run patchelf(pid=24491): Terminated: ok {rc=0} 07:49:38.528334 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24488): Process ended prematurely: osmo-stp_10.42.42.5(pid=24488) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24488)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 07:49:38.537928 tst ping.py:22: Test FAILED (6.8 sec) 07:49:38.565967 run osmo-hlr_10.42.42.2(pid=24485): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24485)] 07:49:38.617298 run osmo-hlr_10.42.42.2(pid=24485): stdout: | (launched: 2022-12-14_07:49:35.165957) 07:49:38.669738 run osmo-hlr_10.42.42.2(pid=24485): stderr: | 20221214074935360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074935360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074935360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074935361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074935361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074935361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074935373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074935382 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074935382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074935382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:38.722461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24484): Terminating (SIGTERM) 07:49:38.764572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24487): Terminating (SIGTERM) 07:49:38.806933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24490): Terminating (SIGTERM) 07:49:38.849829 --- ParallelTerminationStrategy: PID 24484 died... 07:49:38.870530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24484): Terminated: ok {rc=0} 07:49:38.917400 --- ParallelTerminationStrategy: PID 24487 died... 07:49:38.937554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24487): Terminated: ok {rc=0} 07:49:38.984523 --- ParallelTerminationStrategy: PID 24490 died... 07:49:39.004716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24490): Terminated: ok {rc=0} 07:49:39.093840 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:49:40.181594 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:40.193848 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:49:40.267063 tst ping_idle_ping.py: using LAC 39461 07:49:40.395178 tst ping_idle_ping.py: using RAC 191 07:49:40.525954 tst ping_idle_ping.py: using CellId 39461 07:49:40.653263 tst ping_idle_ping.py: using BVCI 39462 07:49:40.770409 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:40.781992 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:40.793347 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:40.804518 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:40.816346 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:40.827964 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:40.839674 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:49:40.851234 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:49:40.968509 tst ping_idle_ping.py:24: start network... 07:49:41.171446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:41.642662 run create_hlr_db(pid=24492): Launched 07:49:41.769134 bus /gobi_6: Setting Powered False 07:49:42.833656 run create_hlr_db(pid=24492): Terminated: ok {rc=0} 07:49:43.287600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24494): Launched 07:49:43.614700 run osmo-hlr_10.42.42.2(pid=24495): Launched 07:49:43.740930 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:44.302938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24497): Launched 07:49:44.629109 run osmo-stp_10.42.42.5(pid=24498): Launched 07:49:44.754893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:49:45.314294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24500): Launched 07:49:45.440796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:49:45.713800 run patchelf(pid=24501): Launched 07:49:45.915017 run osmo-stp_10.42.42.5(pid=24498): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24498)] 07:49:46.068265 run osmo-stp_10.42.42.5(pid=24498): stdout: | (launched: 2022-12-14_07:49:44.569151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:46.236737 run osmo-stp_10.42.42.5(pid=24498): stderr: | 20221214074944756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074944756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074944757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074944757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074944758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074944758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074944758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:46.370786 run osmo-stp_10.42.42.5(pid=24498): stdout: | (launched: 2022-12-14_07:49:44.569151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:46.496427 run osmo-stp_10.42.42.5(pid=24498): stderr: | 20221214074944756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074944756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074944757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074944757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074944758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074944758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074944758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:46.691204 run patchelf(pid=24501): Terminating (SIGINT) 07:49:46.882101 run patchelf(pid=24501): Terminated: ok {rc=0} 07:49:47.010542 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24498): Process ended prematurely: osmo-stp_10.42.42.5(pid=24498) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24498)] [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:49:47.020434 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:49:47.049174 run osmo-hlr_10.42.42.2(pid=24495): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24495)] 07:49:47.098888 run osmo-hlr_10.42.42.2(pid=24495): stdout: | (launched: 2022-12-14_07:49:43.554912) 07:49:47.150795 run osmo-hlr_10.42.42.2(pid=24495): stderr: | 20221214074943749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074943749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074943749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074943749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074943749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074943749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074943766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074943776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074943777 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074943777 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:47.204129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24494): Terminating (SIGTERM) 07:49:47.245672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24497): Terminating (SIGTERM) 07:49:47.289298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24500): Terminating (SIGTERM) 07:49:47.333062 --- ParallelTerminationStrategy: PID 24494 died... 07:49:47.352614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24494): Terminated: ok {rc=0} 07:49:47.398540 --- ParallelTerminationStrategy: PID 24497 died... 07:49:47.417528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24497): Terminated: ok {rc=0} 07:49:47.461838 --- ParallelTerminationStrategy: PID 24500 died... 07:49:47.480722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24500): Terminated: ok {rc=0} 07:49:47.565014 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:49:48.865217 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:49:48.873261 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:49:48.907946 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:49:48.943600 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:49:48.999219 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:49:49.033085 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:49:49.068656 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:49:49.625242 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:49:49.630837 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:49:49.642813 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:49:49.716720 tst switch_tch_pdch.py: using LAC 39462 07:49:49.845708 tst switch_tch_pdch.py: using RAC 192 07:49:49.976724 tst switch_tch_pdch.py: using CellId 39462 07:49:50.103234 tst switch_tch_pdch.py: using BVCI 39463 07:49:50.221094 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:49:50.233023 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:49:50.244441 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:49:50.256010 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:49:50.267987 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:49:50.279912 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:49:50.291968 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:49:50.303795 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:49:50.426727 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:49:50.552137 tst switch_tch_pdch.py:51: start network... 07:49:50.756075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:51.224222 run create_hlr_db(pid=24505): Launched 07:49:51.347357 bus /gobi_6: Setting Powered False 07:49:52.407214 run create_hlr_db(pid=24505): Terminated: ok {rc=0} 07:49:52.828736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24507): Launched 07:49:53.130890 run osmo-hlr_10.42.42.2(pid=24508): Launched 07:49:53.245103 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:53.762929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24510): Launched 07:49:54.064706 run osmo-stp_10.42.42.5(pid=24511): Launched 07:49:54.179056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:49:54.698269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24513): Launched 07:49:54.813573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:49:55.067262 run patchelf(pid=24514): Launched 07:49:55.234900 run osmo-stp_10.42.42.5(pid=24511): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24511)] 07:49:55.362488 run osmo-stp_10.42.42.5(pid=24511): stdout: | (launched: 2022-12-14_07:49:54.009157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:55.492374 run osmo-stp_10.42.42.5(pid=24511): stderr: | 20221214074954176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074954177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074954177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074954177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074954178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074954178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074954178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:55.621183 run osmo-stp_10.42.42.5(pid=24511): stdout: | (launched: 2022-12-14_07:49:54.009157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:55.743263 run osmo-stp_10.42.42.5(pid=24511): stderr: | 20221214074954176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214074954177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214074954177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214074954177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214074954178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214074954178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214074954178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:55.887791 run patchelf(pid=24514): Terminating (SIGINT) 07:49:56.057972 run patchelf(pid=24514): Terminated: ok {rc=0} 07:49:56.180806 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24511): Process ended prematurely: osmo-stp_10.42.42.5(pid=24511) [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24511)] [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:49:56.189620 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 07:49:56.216199 run osmo-hlr_10.42.42.2(pid=24508): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24508)] 07:49:56.263282 run osmo-hlr_10.42.42.2(pid=24508): stdout: | (launched: 2022-12-14_07:49:53.075045) 07:49:56.312235 run osmo-hlr_10.42.42.2(pid=24508): stderr: | 20221214074953247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214074953247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214074953247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214074953247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214074953247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214074953247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214074953260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214074953269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214074953269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214074953269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:56.361673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24507): Terminating (SIGTERM) 07:49:56.401173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24510): Terminating (SIGTERM) 07:49:56.440602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24513): Terminating (SIGTERM) 07:49:56.480062 --- ParallelTerminationStrategy: PID 24507 died... 07:49:56.499034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24507): Terminated: ok {rc=0} 07:49:56.542351 --- ParallelTerminationStrategy: PID 24510 died... 07:49:56.560528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24510): Terminated: ok {rc=0} 07:49:56.603683 --- ParallelTerminationStrategy: PID 24513 died... 07:49:56.622019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24513): Terminated: ok {rc=0} 07:49:56.705208 bus /gobi_0: Setting Powered False 07:49:57.802843 bus /gobi_0: Setting Powered False 07:49:58.918053 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:50:00.166822 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:00.172623 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:50:00.205228 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:50:00.240784 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:50:00.297198 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:50:00.332101 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:50:00.367846 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:50:00.930430 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:50:00.940925 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:50:00.953311 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:50:01.029422 tst switch_tch_pdch.py: using LAC 39463 07:50:01.162272 tst switch_tch_pdch.py: using RAC 193 07:50:01.283461 tst switch_tch_pdch.py: using CellId 39463 07:50:01.406639 tst switch_tch_pdch.py: using BVCI 39464 07:50:01.521677 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:50:01.534008 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:50:01.546003 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:50:01.558005 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:50:01.570671 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:50:01.583353 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:50:01.596107 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:50:01.608522 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:50:01.732345 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:50:01.858807 tst switch_tch_pdch.py:51: start network... 07:50:02.138476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:02.623484 run create_hlr_db(pid=24526): Launched 07:50:02.781849 bus /gobi_6: Setting Powered False 07:50:03.842101 run create_hlr_db(pid=24526): Terminated: ok {rc=0} 07:50:04.255733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24530): Launched 07:50:04.580168 run osmo-hlr_10.42.42.2(pid=24531): Launched 07:50:04.704409 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:05.231751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24533): Launched 07:50:05.557863 run osmo-stp_10.42.42.5(pid=24534): Launched 07:50:05.683948 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:50:06.218813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24536): Launched 07:50:06.343025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:50:06.616095 run patchelf(pid=24537): Launched 07:50:06.798608 run osmo-stp_10.42.42.5(pid=24534): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24534)] 07:50:06.935541 run osmo-stp_10.42.42.5(pid=24534): stdout: | (launched: 2022-12-14_07:50:05.498542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:07.074972 run osmo-stp_10.42.42.5(pid=24534): stderr: | 20221214075005686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075005687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075005687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075005687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075005688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075005688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075005688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:07.213986 run osmo-stp_10.42.42.5(pid=24534): stdout: | (launched: 2022-12-14_07:50:05.498542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:07.346089 run osmo-stp_10.42.42.5(pid=24534): stderr: | 20221214075005686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075005687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075005687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075005687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075005688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075005688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075005688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:07.502920 run patchelf(pid=24537): Terminating (SIGINT) 07:50:07.685966 run patchelf(pid=24537): Terminated: ok {rc=0} 07:50:07.819354 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24534): Process ended prematurely: osmo-stp_10.42.42.5(pid=24534) [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24534)] [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:50:07.828794 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 07:50:07.856794 run osmo-hlr_10.42.42.2(pid=24531): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24531)] 07:50:07.907003 run osmo-hlr_10.42.42.2(pid=24531): stdout: | (launched: 2022-12-14_07:50:04.520700) 07:50:07.958771 run osmo-hlr_10.42.42.2(pid=24531): stderr: | 20221214075004715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075004715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075004715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075004716 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075004716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075004716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075004728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075004736 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075004736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075004736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:08.011487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24530): Terminating (SIGTERM) 07:50:08.053393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24533): Terminating (SIGTERM) 07:50:08.095478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24536): Terminating (SIGTERM) 07:50:08.137698 --- ParallelTerminationStrategy: PID 24530 died... 07:50:08.158238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24530): Terminated: ok {rc=0} 07:50:08.204786 --- ParallelTerminationStrategy: PID 24533 died... 07:50:08.225389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24533): Terminated: ok {rc=0} 07:50:08.271932 --- ParallelTerminationStrategy: PID 24536 died... 07:50:08.292057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24536): Terminated: ok {rc=0} 07:50:08.381353 bus /gobi_0: Setting Powered False 07:50:09.480886 bus /gobi_0: Setting Powered False 07:50:10.598629 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 07:50:11.847132 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:11.851176 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:50:11.880029 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 07:50:11.886778 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 07:50:11.939540 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:50:11.969483 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 07:50:11.976284 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 07:50:12.511533 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 07:50:12.516724 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 07:50:12.527923 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:50:12.571643 tst mo_mt_sms.py: using LAC 39464 07:50:12.689354 tst mo_mt_sms.py: using RAC 194 07:50:12.806653 tst mo_mt_sms.py: using CellId 39464 07:50:12.930142 tst mo_mt_sms.py: using BVCI 39465 07:50:13.074392 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:50:13.192188 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:50:13.305698 tst mo_mt_sms.py:9: start nitb and bts... 07:50:13.512855 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:50:14.135155 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24736): Launched 07:50:14.485764 run osmo-nitb_10.42.42.2(pid=24813): Launched 07:50:14.657555 run osmo-nitb_10.42.42.2(pid=24813): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24813)] 07:50:14.794726 run osmo-nitb_10.42.42.2(pid=24813): stdout: | (launched: 2022-12-14_07:50:14.422360) 07:50:14.933256 run osmo-nitb_10.42.42.2(pid=24813): stderr: | (launched: 2022-12-14_07:50:14.471394) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:50:15.070319 run osmo-nitb_10.42.42.2(pid=24813): stdout: | (launched: 2022-12-14_07:50:14.422360) 07:50:15.200806 run osmo-nitb_10.42.42.2(pid=24813): stderr: | (launched: 2022-12-14_07:50:14.471394) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24813): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24813) [trial-2401↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24813)] 07:50:15.602914 tst osmo-nitb_10.42.42.2(pid=24813): stdout: | (launched: 2022-12-14_07:50:14.422360) 07:50:15.725257 tst osmo-nitb_10.42.42.2(pid=24813): stderr: | (launched: 2022-12-14_07:50:14.471394) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:50:15.883445 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24813): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24813) [trial-2401↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24813)] [trial-2401↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 07:50:15.892093 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:50:15.902252 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24736): Terminating (SIGTERM) 07:50:16.120450 --- ParallelTerminationStrategy: PID 24736 died... 07:50:16.145884 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24736): Terminated: ok {rc=0} 07:50:16.265608 bus /sierra_3: Setting Powered False 07:50:17.375289 bus /sierra_3: Setting Powered False 07:50:18.494039 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 07:50:19.690985 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:19.695474 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:50:19.725351 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 07:50:19.754177 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 07:50:19.808713 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:50:19.837658 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 07:50:19.864350 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 07:50:20.410808 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 07:50:20.416022 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:20.426923 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:50:20.470294 tst mo_mt_sms.py: using LAC 39465 07:50:20.598369 tst mo_mt_sms.py: using RAC 195 07:50:20.725033 tst mo_mt_sms.py: using CellId 39465 07:50:20.854519 tst mo_mt_sms.py: using BVCI 39466 07:50:20.973608 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:20.985613 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:20.996810 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:21.007969 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:21.019387 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:21.030751 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:50:21.148239 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:50:21.267378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:21.768907 run create_hlr_db(pid=24900): Launched 07:50:21.892790 bus /sierra_2: Setting Powered False 07:50:22.956504 run create_hlr_db(pid=24900): Terminated: ok {rc=0} 07:50:23.389132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24902): Launched 07:50:23.702826 run osmo-hlr_10.42.42.2(pid=24918): Launched 07:50:23.826604 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:24.474871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25026): Launched 07:50:24.795419 run osmo-stp_10.42.42.5(pid=25081): Launched 07:50:25.020940 run osmo-msc_10.42.42.6: Starting osmo-msc 07:50:25.732935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25083): Launched 07:50:26.051592 run osmo-msc_10.42.42.6(pid=25084): Launched 07:50:26.415975 run osmo-stp_10.42.42.5(pid=25081): ERR: Terminated: ERROR {rc=1} [trial-2401↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25081)] 07:50:26.699729 run osmo-stp_10.42.42.5(pid=25081): stdout: | (launched: 2022-12-14_07:50:24.732539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:26.876672 run osmo-stp_10.42.42.5(pid=25081): stderr: | 20221214075025053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075025053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075025054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075025054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075025055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075025055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075025055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:27.016363 run osmo-stp_10.42.42.5(pid=25081): stdout: | (launched: 2022-12-14_07:50:24.732539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:27.149860 run osmo-stp_10.42.42.5(pid=25081): stderr: | 20221214075025053 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075025053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075025054 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075025054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075025055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075025055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075025055 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:27.309712 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25081): Process ended prematurely: osmo-stp_10.42.42.5(pid=25081) [trial-2401↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25081)] [trial-2401↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 07:50:27.319738 tst mo_mt_sms.py:16: Test FAILED (6.9 sec) 07:50:27.349744 run osmo-hlr_10.42.42.2(pid=24918): ERR: Terminated: ERROR {rc=237} [trial-2401↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24918)] 07:50:27.406458 run osmo-hlr_10.42.42.2(pid=24918): stdout: | (launched: 2022-12-14_07:50:23.641123) 07:50:27.461754 run osmo-hlr_10.42.42.2(pid=24918): stderr: | 20221214075023997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075023997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075023998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075023998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075023998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075023998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075024016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075024033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075024034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075024034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:27.539227 run osmo-msc_10.42.42.6(pid=25084): ERR: Terminated: ERROR {rc=2} [trial-2401↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25084)] 07:50:27.594247 run osmo-msc_10.42.42.6(pid=25084): stdout: | (launched: 2022-12-14_07:50:25.994873) 07:50:27.649474 run osmo-msc_10.42.42.6(pid=25084): stderr: | 20221214075026493 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075026493 DLGLOBAL DEBUG validating counter group 0x7faad55bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075026494 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075026494 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075026494 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075026494 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075026496 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075026496 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075026496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075026496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:50:27.705604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24902): Terminating (SIGTERM) 07:50:27.750738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25026): Terminating (SIGTERM) 07:50:27.800183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25083): Terminating (SIGTERM) 07:50:27.847146 --- ParallelTerminationStrategy: PID 24902 died... 07:50:27.869284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24902): Terminated: ok {rc=0} 07:50:27.918513 --- ParallelTerminationStrategy: PID 25026 died... 07:50:27.940401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25026): Terminated: ok {rc=0} 07:50:27.991746 --- ParallelTerminationStrategy: PID 25083 died... 07:50:28.012633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25083): Terminated: ok {rc=0} 07:50:28.107125 bus /sierra_3: Setting Powered False 07:50:29.211527 bus /sierra_3: Setting Powered False 07:50:30.329451 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 07:50:31.592528 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:31.596577 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:50:31.626404 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 07:50:31.634705 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 07:50:31.674015 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:50:31.724507 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 07:50:31.736314 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 07:50:32.229740 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 07:50:32.234808 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 07:50:32.245914 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:50:32.290766 tst assert_extension.py: using LAC 39466 07:50:32.408571 tst assert_extension.py: using RAC 196 07:50:32.526596 tst assert_extension.py: using CellId 39466 07:50:32.644873 tst assert_extension.py: using BVCI 39467 07:50:32.754329 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 07:50:32.875503 tst assert_extension.py:10: start nitb and bts... 07:50:33.096007 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:50:33.759823 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25090): Launched 07:50:34.089271 run osmo-nitb_10.42.42.2(pid=25091): Launched 07:50:34.269990 run osmo-nitb_10.42.42.2(pid=25091): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25091)] 07:50:34.415344 run osmo-nitb_10.42.42.2(pid=25091): stdout: | (launched: 2022-12-14_07:50:34.028925) 07:50:34.562511 run osmo-nitb_10.42.42.2(pid=25091): stderr: | (launched: 2022-12-14_07:50:34.077553) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:50:34.709412 run osmo-nitb_10.42.42.2(pid=25091): stdout: | (launched: 2022-12-14_07:50:34.028925) 07:50:34.850142 run osmo-nitb_10.42.42.2(pid=25091): stderr: | (launched: 2022-12-14_07:50:34.077553) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25091): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25091) [trial-2401↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25091)] 07:50:35.211855 tst osmo-nitb_10.42.42.2(pid=25091): stdout: | (launched: 2022-12-14_07:50:34.028925) 07:50:35.343861 tst osmo-nitb_10.42.42.2(pid=25091): stderr: | (launched: 2022-12-14_07:50:34.077553) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:50:35.500341 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25091): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25091) [trial-2401↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25091)] [trial-2401↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 07:50:35.509383 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:50:35.516618 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25090): Terminating (SIGTERM) 07:50:35.727818 --- ParallelTerminationStrategy: PID 25090 died... 07:50:35.749610 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25090): Terminated: ok {rc=0} 07:50:35.839954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 07:50:37.017824 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:37.022077 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:50:37.051812 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 07:50:37.080511 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 07:50:37.117640 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:50:37.148300 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 07:50:37.175943 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 07:50:37.705776 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 07:50:37.711007 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:37.722366 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:50:37.767757 tst assert_extension.py: using LAC 39467 07:50:37.897134 tst assert_extension.py: using RAC 197 07:50:38.025236 tst assert_extension.py: using CellId 39467 07:50:38.151665 tst assert_extension.py: using BVCI 39468 07:50:38.269707 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:38.280898 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:38.292070 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:38.303187 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:38.314739 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:50:38.326152 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 07:50:38.446887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:38.950670 run create_hlr_db(pid=25095): Launched 07:50:39.075254 bus /sierra_2: Setting Powered False 07:50:40.139522 run create_hlr_db(pid=25095): Terminated: ok {rc=0} 07:50:40.575902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25097): Launched 07:50:40.882979 run osmo-hlr_10.42.42.2(pid=25098): Launched 07:50:40.998537 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:41.541056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25100): Launched 07:50:41.845952 run osmo-stp_10.42.42.5(pid=25101): Launched 07:50:41.998245 run osmo-msc_10.42.42.6: Starting osmo-msc 07:50:42.543891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25103): Launched 07:50:42.849935 run osmo-msc_10.42.42.6(pid=25104): Launched 07:50:43.019352 run osmo-stp_10.42.42.5(pid=25101): ERR: Terminated: ERROR {rc=1} [trial-2401↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25101)] 07:50:43.146900 run osmo-stp_10.42.42.5(pid=25101): stdout: | (launched: 2022-12-14_07:50:41.788441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:43.274656 run osmo-stp_10.42.42.5(pid=25101): stderr: | 20221214075041994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075041995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075041995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075041995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075041996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075041996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075041996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:43.399558 run osmo-stp_10.42.42.5(pid=25101): stdout: | (launched: 2022-12-14_07:50:41.788441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:43.519242 run osmo-stp_10.42.42.5(pid=25101): stderr: | 20221214075041994 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075041995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075041995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075041995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075041996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075041996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075041996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:43.662625 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25101): Process ended prematurely: osmo-stp_10.42.42.5(pid=25101) [trial-2401↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25101)] [trial-2401↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 07:50:43.670798 tst assert_extension.py:17: Test FAILED (6.0 sec) 07:50:43.697156 run osmo-hlr_10.42.42.2(pid=25098): ERR: Terminated: ERROR {rc=237} [trial-2401↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25098)] 07:50:43.744796 run osmo-hlr_10.42.42.2(pid=25098): stdout: | (launched: 2022-12-14_07:50:40.826672) 07:50:43.794181 run osmo-hlr_10.42.42.2(pid=25098): stderr: | 20221214075041000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075041001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075041001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075041001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075041001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075041001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075041013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075041021 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075041021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075041021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:43.863953 run osmo-msc_10.42.42.6(pid=25104): ERR: Terminated: ERROR {rc=2} [trial-2401↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25104)] 07:50:43.911377 run osmo-msc_10.42.42.6(pid=25104): stdout: | (launched: 2022-12-14_07:50:42.792883) 07:50:43.960730 run osmo-msc_10.42.42.6(pid=25104): stderr: | 20221214075043064 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075043064 DLGLOBAL DEBUG validating counter group 0x7f6243f3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075043064 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075043064 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075043064 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075043065 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075043066 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075043067 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075043067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075043067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:50:44.010568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25097): Terminating (SIGTERM) 07:50:44.050552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25100): Terminating (SIGTERM) 07:50:44.090440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25103): Terminating (SIGTERM) 07:50:44.130557 --- ParallelTerminationStrategy: PID 25097 died... 07:50:44.149918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25097): Terminated: ok {rc=0} 07:50:44.194020 --- ParallelTerminationStrategy: PID 25100 died... 07:50:44.212676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25100): Terminated: ok {rc=0} 07:50:44.256923 --- ParallelTerminationStrategy: PID 25103 died... 07:50:44.275726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25103): Terminated: ok {rc=0} 07:50:44.361754 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:50:45.571593 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:45.578680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:50:45.607992 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:50:45.635099 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:50:45.687350 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:50:45.717877 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:50:45.746328 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:50:46.295559 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:50:46.349134 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:46.361693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:50:46.429382 tst mo_mt_call.py: using LAC 39468 07:50:46.555515 tst mo_mt_call.py: using RAC 198 07:50:46.682887 tst mo_mt_call.py: using CellId 39468 07:50:46.817054 tst mo_mt_call.py: using BVCI 39469 07:50:46.947826 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:46.960712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:46.973605 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:46.986299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:47.000785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:47.015456 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:50:47.156691 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:50:47.281967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:47.796275 run create_hlr_db(pid=25109): Launched 07:50:47.925259 bus /sierra_2: Setting Powered False 07:50:48.990611 run create_hlr_db(pid=25109): Terminated: ok {rc=0} 07:50:49.450485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25111): Launched 07:50:49.782788 run osmo-hlr_10.42.42.2(pid=25112): Launched 07:50:49.911442 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:50.483982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25114): Launched 07:50:50.818335 run osmo-stp_10.42.42.5(pid=25115): Launched 07:50:50.946725 run osmo-msc_10.42.42.6: Starting osmo-msc 07:50:51.543013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25117): Launched 07:50:51.875655 run osmo-msc_10.42.42.6(pid=25118): Launched 07:50:52.071566 run osmo-stp_10.42.42.5(pid=25115): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25115)] 07:50:52.211676 run osmo-stp_10.42.42.5(pid=25115): stdout: | (launched: 2022-12-14_07:50:50.757384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:52.351972 run osmo-stp_10.42.42.5(pid=25115): stderr: | 20221214075050952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075050952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075050952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075050953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075050953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075050953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075050953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:52.489878 run osmo-stp_10.42.42.5(pid=25115): stdout: | (launched: 2022-12-14_07:50:50.757384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:52.621201 run osmo-stp_10.42.42.5(pid=25115): stderr: | 20221214075050952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075050952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075050952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075050953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075050953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075050953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075050953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:52.778467 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25115): Process ended prematurely: osmo-stp_10.42.42.5(pid=25115) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25115)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:50:52.788276 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 07:50:52.816465 run osmo-hlr_10.42.42.2(pid=25112): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25112)] 07:50:52.867159 run osmo-hlr_10.42.42.2(pid=25112): stdout: | (launched: 2022-12-14_07:50:49.722036) 07:50:52.919724 run osmo-hlr_10.42.42.2(pid=25112): stderr: | 20221214075049919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075049919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075049919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075049919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075049919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075049919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075049934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075049942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075049943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075049943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:52.991977 run osmo-msc_10.42.42.6(pid=25118): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25118)] 07:50:53.042432 run osmo-msc_10.42.42.6(pid=25118): stdout: | (launched: 2022-12-14_07:50:51.814554) 07:50:53.095309 run osmo-msc_10.42.42.6(pid=25118): stderr: | 20221214075052139 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075052139 DLGLOBAL DEBUG validating counter group 0x7f09e7f94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075052139 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075052139 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075052139 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075052139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075052142 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075052142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075052142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075052142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:50:53.147663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25111): Terminating (SIGTERM) 07:50:53.189674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25114): Terminating (SIGTERM) 07:50:53.232052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25117): Terminating (SIGTERM) 07:50:53.274478 --- ParallelTerminationStrategy: PID 25111 died... 07:50:53.294940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25111): Terminated: ok {rc=0} 07:50:53.341614 --- ParallelTerminationStrategy: PID 25114 died... 07:50:53.361767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25114): Terminated: ok {rc=0} 07:50:53.408173 --- ParallelTerminationStrategy: PID 25117 died... 07:50:53.428220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25117): Terminated: ok {rc=0} 07:50:53.515986 bus /sierra_3: Setting Powered False 07:50:54.613517 bus /sierra_3: Setting Powered False 07:50:55.727872 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:50:56.875113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:56.887171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:50:56.954983 tst mo_mt_call_osmux.py: using LAC 39469 07:50:57.080448 tst mo_mt_call_osmux.py: using RAC 199 07:50:57.200889 tst mo_mt_call_osmux.py: using CellId 39469 07:50:57.320044 tst mo_mt_call_osmux.py: using BVCI 39470 07:50:57.433151 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:57.444594 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:57.455807 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:57.466889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:57.478171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:50:57.489323 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:50:57.607269 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:50:57.728363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:58.242586 run create_hlr_db(pid=25120): Launched 07:50:58.371954 bus /sierra_2: Setting Powered False 07:50:59.436596 run create_hlr_db(pid=25120): Terminated: ok {rc=0} 07:50:59.877431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25122): Launched 07:51:00.190351 run osmo-hlr_10.42.42.2(pid=25123): Launched 07:51:00.310178 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:00.865884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25125): Launched 07:51:01.239505 run osmo-stp_10.42.42.5(pid=25126): Launched 07:51:01.511233 run osmo-msc_10.42.42.6: Starting osmo-msc 07:51:02.258492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25128): Launched 07:51:02.614577 run osmo-msc_10.42.42.6(pid=25129): Launched 07:51:02.802241 run osmo-stp_10.42.42.5(pid=25126): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25126)] 07:51:02.941881 run osmo-stp_10.42.42.5(pid=25126): stdout: | (launched: 2022-12-14_07:51:01.140260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:03.082506 run osmo-stp_10.42.42.5(pid=25126): stderr: | 20221214075101531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075101531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075101532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075101532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075101532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075101533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075101533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:03.220890 run osmo-stp_10.42.42.5(pid=25126): stdout: | (launched: 2022-12-14_07:51:01.140260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:03.351682 run osmo-stp_10.42.42.5(pid=25126): stderr: | 20221214075101531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075101531 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075101532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075101532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075101532 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075101533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075101533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:03.509453 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25126): Process ended prematurely: osmo-stp_10.42.42.5(pid=25126) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25126)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:51:03.519059 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 07:51:03.547408 run osmo-hlr_10.42.42.2(pid=25123): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25123)] 07:51:03.598767 run osmo-hlr_10.42.42.2(pid=25123): stdout: | (launched: 2022-12-14_07:51:00.132266) 07:51:03.651430 run osmo-hlr_10.42.42.2(pid=25123): stderr: | 20221214075100306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075100306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075100306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075100306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075100306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075100306 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075100318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075100326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075100326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075100326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:03.724522 run osmo-msc_10.42.42.6(pid=25129): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25129)] 07:51:03.774549 run osmo-msc_10.42.42.6(pid=25129): stdout: | (launched: 2022-12-14_07:51:02.553140) 07:51:03.827224 run osmo-msc_10.42.42.6(pid=25129): stderr: | 20221214075102878 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075102878 DLGLOBAL DEBUG validating counter group 0x7fc5f8c77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075102878 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075102878 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075102878 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075102879 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075102880 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075102881 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075102881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075102881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:51:03.879691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25122): Terminating (SIGTERM) 07:51:03.921766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25125): Terminating (SIGTERM) 07:51:03.964193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25128): Terminating (SIGTERM) 07:51:04.007287 --- ParallelTerminationStrategy: PID 25122 died... 07:51:04.027976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25122): Terminated: ok {rc=0} 07:51:04.075201 --- ParallelTerminationStrategy: PID 25125 died... 07:51:04.095197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25125): Terminated: ok {rc=0} 07:51:04.141715 --- ParallelTerminationStrategy: PID 25128 died... 07:51:04.161833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25128): Terminated: ok {rc=0} 07:51:04.250567 bus /sierra_3: Setting Powered False 07:51:05.349879 bus /sierra_3: Setting Powered False 07:51:06.464229 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:51:07.722025 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:51:07.730711 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:51:07.761094 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:51:07.789849 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:51:07.849644 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:51:07.880064 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:51:07.907533 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:51:08.456325 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:51:08.512135 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:08.524083 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:51:08.592596 tst mo_mt_call.py: using LAC 39470 07:51:08.723897 tst mo_mt_call.py: using RAC 200 07:51:08.847455 tst mo_mt_call.py: using CellId 39470 07:51:08.971119 tst mo_mt_call.py: using BVCI 39471 07:51:09.084848 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:09.096325 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:09.107750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:09.118927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:09.130138 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:09.141214 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:51:09.263449 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:51:09.384437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:09.863053 run create_hlr_db(pid=25134): Launched 07:51:09.992242 bus /sierra_2: Setting Powered False 07:51:11.054489 run create_hlr_db(pid=25134): Terminated: ok {rc=0} 07:51:11.505983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25136): Launched 07:51:11.838869 run osmo-hlr_10.42.42.2(pid=25137): Launched 07:51:11.967189 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:12.540358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25139): Launched 07:51:12.874681 run osmo-stp_10.42.42.5(pid=25140): Launched 07:51:13.002637 run osmo-msc_10.42.42.6: Starting osmo-msc 07:51:13.602814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25142): Launched 07:51:13.935657 run osmo-msc_10.42.42.6(pid=25143): Launched 07:51:14.123766 run osmo-stp_10.42.42.5(pid=25140): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25140)] 07:51:14.263804 run osmo-stp_10.42.42.5(pid=25140): stdout: | (launched: 2022-12-14_07:51:12.813395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:14.405018 run osmo-stp_10.42.42.5(pid=25140): stderr: | 20221214075113006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075113006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075113006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075113006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075113007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075113007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075113007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:14.543245 run osmo-stp_10.42.42.5(pid=25140): stdout: | (launched: 2022-12-14_07:51:12.813395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:14.674829 run osmo-stp_10.42.42.5(pid=25140): stderr: | 20221214075113006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075113006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075113006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075113006 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075113007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075113007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075113007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:14.832354 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25140): Process ended prematurely: osmo-stp_10.42.42.5(pid=25140) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25140)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:51:14.842165 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:51:14.870539 run osmo-hlr_10.42.42.2(pid=25137): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25137)] 07:51:14.921473 run osmo-hlr_10.42.42.2(pid=25137): stdout: | (launched: 2022-12-14_07:51:11.777810) 07:51:14.973863 run osmo-hlr_10.42.42.2(pid=25137): stderr: | 20221214075111976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075111976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075111976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075111976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075111976 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075111976 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075111990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075112000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075112000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075112001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:15.046468 run osmo-msc_10.42.42.6(pid=25143): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25143)] 07:51:15.096138 run osmo-msc_10.42.42.6(pid=25143): stdout: | (launched: 2022-12-14_07:51:13.874464) 07:51:15.148118 run osmo-msc_10.42.42.6(pid=25143): stderr: | 20221214075114198 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075114198 DLGLOBAL DEBUG validating counter group 0x7fe950212c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075114198 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075114198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075114198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075114198 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075114200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075114200 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075114201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075114201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:51:15.200347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25136): Terminating (SIGTERM) 07:51:15.242292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25139): Terminating (SIGTERM) 07:51:15.284301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25142): Terminating (SIGTERM) 07:51:15.326839 --- ParallelTerminationStrategy: PID 25136 died... 07:51:15.347484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25136): Terminated: ok {rc=0} 07:51:15.394171 --- ParallelTerminationStrategy: PID 25139 died... 07:51:15.414341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25139): Terminated: ok {rc=0} 07:51:15.460579 --- ParallelTerminationStrategy: PID 25142 died... 07:51:15.480626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25142): Terminated: ok {rc=0} 07:51:15.568759 bus /sierra_3: Setting Powered False 07:51:16.665204 bus /sierra_3: Setting Powered False 07:51:17.782619 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:51:18.929241 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:18.941797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:51:19.007880 tst mo_mt_call_osmux.py: using LAC 39471 07:51:19.130267 tst mo_mt_call_osmux.py: using RAC 201 07:51:19.252830 tst mo_mt_call_osmux.py: using CellId 39471 07:51:19.375488 tst mo_mt_call_osmux.py: using BVCI 39472 07:51:19.488776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:19.500336 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:19.511549 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:19.522796 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:19.534099 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:51:19.545302 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:51:19.663672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:51:19.788273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:20.303518 run create_hlr_db(pid=25145): Launched 07:51:20.432837 bus /sierra_2: Setting Powered False 07:51:21.498226 run create_hlr_db(pid=25145): Terminated: ok {rc=0} 07:51:21.940650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25147): Launched 07:51:22.251045 run osmo-hlr_10.42.42.2(pid=25148): Launched 07:51:22.368105 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:22.918003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25150): Launched 07:51:23.229354 run osmo-stp_10.42.42.5(pid=25151): Launched 07:51:23.346971 run osmo-msc_10.42.42.6: Starting osmo-msc 07:51:23.906148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25153): Launched 07:51:24.220904 run osmo-msc_10.42.42.6(pid=25154): Launched 07:51:24.393655 run osmo-stp_10.42.42.5(pid=25151): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25151)] 07:51:24.523770 run osmo-stp_10.42.42.5(pid=25151): stdout: | (launched: 2022-12-14_07:51:23.171914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:24.654287 run osmo-stp_10.42.42.5(pid=25151): stderr: | 20221214075123344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075123344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075123344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075123345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075123345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075123345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075123345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:24.782508 run osmo-stp_10.42.42.5(pid=25151): stdout: | (launched: 2022-12-14_07:51:23.171914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:24.904537 run osmo-stp_10.42.42.5(pid=25151): stderr: | 20221214075123344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075123344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075123344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075123345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075123345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075123345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075123345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:25.051227 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25151): Process ended prematurely: osmo-stp_10.42.42.5(pid=25151) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25151)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:51:25.060231 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:51:25.087196 run osmo-hlr_10.42.42.2(pid=25148): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25148)] 07:51:25.135017 run osmo-hlr_10.42.42.2(pid=25148): stdout: | (launched: 2022-12-14_07:51:22.193849) 07:51:25.184632 run osmo-hlr_10.42.42.2(pid=25148): stderr: | 20221214075122369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075122369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075122369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075122369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075122369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075122369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075122381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075122389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075122390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075122390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:25.254185 run osmo-msc_10.42.42.6(pid=25154): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25154)] 07:51:25.301976 run osmo-msc_10.42.42.6(pid=25154): stdout: | (launched: 2022-12-14_07:51:24.162938) 07:51:25.351323 run osmo-msc_10.42.42.6(pid=25154): stderr: | 20221214075124436 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075124436 DLGLOBAL DEBUG validating counter group 0x7fc4aa519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075124436 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075124436 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075124436 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075124437 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075124438 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075124439 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075124439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075124439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:51:25.400901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25147): Terminating (SIGTERM) 07:51:25.441039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25150): Terminating (SIGTERM) 07:51:25.481231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25153): Terminating (SIGTERM) 07:51:25.521933 --- ParallelTerminationStrategy: PID 25147 died... 07:51:25.541505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25147): Terminated: ok {rc=0} 07:51:25.585791 --- ParallelTerminationStrategy: PID 25150 died... 07:51:25.604528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25150): Terminated: ok {rc=0} 07:51:25.649226 --- ParallelTerminationStrategy: PID 25153 died... 07:51:25.668198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25153): Terminated: ok {rc=0} 07:51:25.753091 bus /sierra_3: Setting Powered False 07:51:26.852602 bus /sierra_3: Setting Powered False 07:51:27.970790 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:51:29.223939 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:51:29.232745 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:51:29.262744 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:51:29.291551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:51:29.344023 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:51:29.373639 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:51:29.401075 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:51:29.954746 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:51:30.006353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:30.017980 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:51:30.085834 tst mo_mt_call.py: using LAC 39472 07:51:30.214583 tst mo_mt_call.py: using RAC 202 07:51:30.336837 tst mo_mt_call.py: using CellId 39472 07:51:30.457789 tst mo_mt_call.py: using BVCI 39473 07:51:30.569718 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:30.581420 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:30.592509 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:30.603702 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:30.614887 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:30.626124 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:51:30.748416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:51:30.870351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:31.375184 run create_hlr_db(pid=25159): Launched 07:51:31.537065 bus /sierra_2: Setting Powered False 07:51:32.602048 run create_hlr_db(pid=25159): Terminated: ok {rc=0} 07:51:33.048871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25161): Launched 07:51:33.361203 run osmo-hlr_10.42.42.2(pid=25162): Launched 07:51:33.479089 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:34.011041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25164): Launched 07:51:34.322704 run osmo-stp_10.42.42.5(pid=25165): Launched 07:51:34.440530 run osmo-msc_10.42.42.6: Starting osmo-msc 07:51:35.002442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25167): Launched 07:51:35.315513 run osmo-msc_10.42.42.6(pid=25168): Launched 07:51:35.489324 run osmo-stp_10.42.42.5(pid=25165): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25165)] 07:51:35.618936 run osmo-stp_10.42.42.5(pid=25165): stdout: | (launched: 2022-12-14_07:51:34.265590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:35.749032 run osmo-stp_10.42.42.5(pid=25165): stderr: | 20221214075134436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075134436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075134436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075134437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075134437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075134437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075134437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:35.877646 run osmo-stp_10.42.42.5(pid=25165): stdout: | (launched: 2022-12-14_07:51:34.265590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:36.000018 run osmo-stp_10.42.42.5(pid=25165): stderr: | 20221214075134436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075134436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075134436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075134437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075134437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075134437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075134437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:36.147117 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25165): Process ended prematurely: osmo-stp_10.42.42.5(pid=25165) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25165)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:51:36.156266 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:51:36.183097 run osmo-hlr_10.42.42.2(pid=25162): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25162)] 07:51:36.231300 run osmo-hlr_10.42.42.2(pid=25162): stdout: | (launched: 2022-12-14_07:51:33.302972) 07:51:36.281492 run osmo-hlr_10.42.42.2(pid=25162): stderr: | 20221214075133481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075133481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075133481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075133481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075133481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075133481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075133547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075133556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075133557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075133557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:36.350886 run osmo-msc_10.42.42.6(pid=25168): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25168)] 07:51:36.398633 run osmo-msc_10.42.42.6(pid=25168): stdout: | (launched: 2022-12-14_07:51:35.258125) 07:51:36.447928 run osmo-msc_10.42.42.6(pid=25168): stderr: | 20221214075135531 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075135531 DLGLOBAL DEBUG validating counter group 0x7f0d7483bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075135531 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075135531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075135531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075135531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075135533 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075135533 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075135534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075135534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:51:36.497445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25161): Terminating (SIGTERM) 07:51:36.537637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25164): Terminating (SIGTERM) 07:51:36.577633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25167): Terminating (SIGTERM) 07:51:36.618273 --- ParallelTerminationStrategy: PID 25161 died... 07:51:36.637684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25161): Terminated: ok {rc=0} 07:51:36.681798 --- ParallelTerminationStrategy: PID 25164 died... 07:51:36.700467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25164): Terminated: ok {rc=0} 07:51:36.744673 --- ParallelTerminationStrategy: PID 25167 died... 07:51:36.763653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25167): Terminated: ok {rc=0} 07:51:36.850467 bus /sierra_3: Setting Powered False 07:51:37.950191 bus /sierra_3: Setting Powered False 07:51:39.066918 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:51:40.213985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:40.226119 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:51:40.291838 tst mo_mt_call_osmux.py: using LAC 39473 07:51:40.414799 tst mo_mt_call_osmux.py: using RAC 203 07:51:40.537058 tst mo_mt_call_osmux.py: using CellId 39473 07:51:40.658408 tst mo_mt_call_osmux.py: using BVCI 39474 07:51:40.771370 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:40.782800 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:40.793955 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:40.805497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:40.816739 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:51:40.827836 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:51:40.949655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:51:41.073588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:41.588046 run create_hlr_db(pid=25170): Launched 07:51:41.716923 bus /sierra_2: Setting Powered False 07:51:42.781813 run create_hlr_db(pid=25170): Terminated: ok {rc=0} 07:51:43.224070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25172): Launched 07:51:43.534248 run osmo-hlr_10.42.42.2(pid=25173): Launched 07:51:43.652717 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:44.185385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25175): Launched 07:51:44.497749 run osmo-stp_10.42.42.5(pid=25176): Launched 07:51:44.617154 run osmo-msc_10.42.42.6: Starting osmo-msc 07:51:45.180729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25178): Launched 07:51:45.492598 run osmo-msc_10.42.42.6(pid=25179): Launched 07:51:45.666873 run osmo-stp_10.42.42.5(pid=25176): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25176)] 07:51:45.796275 run osmo-stp_10.42.42.5(pid=25176): stdout: | (launched: 2022-12-14_07:51:44.440279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:45.963898 run osmo-stp_10.42.42.5(pid=25176): stderr: | 20221214075144610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075144610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075144611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075144611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075144612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075144612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075144612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:46.108169 run osmo-stp_10.42.42.5(pid=25176): stdout: | (launched: 2022-12-14_07:51:44.440279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:46.245463 run osmo-stp_10.42.42.5(pid=25176): stderr: | 20221214075144610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075144610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075144611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075144611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075144612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075144612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075144612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:46.410472 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25176): Process ended prematurely: osmo-stp_10.42.42.5(pid=25176) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25176)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:51:46.421439 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:51:46.451120 run osmo-hlr_10.42.42.2(pid=25173): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25173)] 07:51:46.506335 run osmo-hlr_10.42.42.2(pid=25173): stdout: | (launched: 2022-12-14_07:51:43.477142) 07:51:46.561832 run osmo-hlr_10.42.42.2(pid=25173): stderr: | 20221214075143653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075143653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075143653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075143653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075143653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075143653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075143666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075143674 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075143675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075143675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:46.639344 run osmo-msc_10.42.42.6(pid=25179): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25179)] 07:51:46.693421 run osmo-msc_10.42.42.6(pid=25179): stdout: | (launched: 2022-12-14_07:51:45.434970) 07:51:46.748725 run osmo-msc_10.42.42.6(pid=25179): stderr: | 20221214075145708 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075145708 DLGLOBAL DEBUG validating counter group 0x7f73e16bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075145708 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075145709 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075145709 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075145709 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075145711 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075145711 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075145711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075145711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:51:46.805128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25172): Terminating (SIGTERM) 07:51:46.850255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25175): Terminating (SIGTERM) 07:51:46.897479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25178): Terminating (SIGTERM) 07:51:46.944290 --- ParallelTerminationStrategy: PID 25172 died... 07:51:46.967731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25172): Terminated: ok {rc=0} 07:51:47.018033 --- ParallelTerminationStrategy: PID 25175 died... 07:51:47.039590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25175): Terminated: ok {rc=0} 07:51:47.088567 --- ParallelTerminationStrategy: PID 25178 died... 07:51:47.110077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25178): Terminated: ok {rc=0} 07:51:47.203064 bus /sierra_3: Setting Powered False 07:51:48.302241 bus /sierra_3: Setting Powered False 07:51:49.418328 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:51:50.666277 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:51:50.673622 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:51:50.703503 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:51:50.732269 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:51:50.785035 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:51:50.814865 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:51:50.842901 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:51:51.394975 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:51:51.449450 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:51:51.461506 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:51:51.529333 tst mo_mt_call.py: using LAC 39474 07:51:51.652156 tst mo_mt_call.py: using RAC 204 07:51:51.775787 tst mo_mt_call.py: using CellId 39474 07:51:51.897882 tst mo_mt_call.py: using BVCI 39475 07:51:52.011757 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:51:52.023125 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:51:52.034398 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:51:52.045617 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:51:52.056805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:51:52.067988 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:51:52.189524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:51:52.312704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:52.828165 run create_hlr_db(pid=25184): Launched 07:51:52.957921 bus /sierra_2: Setting Powered False 07:51:54.023198 run create_hlr_db(pid=25184): Terminated: ok {rc=0} 07:51:54.487029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25186): Launched 07:51:54.821633 run osmo-hlr_10.42.42.2(pid=25187): Launched 07:51:54.950203 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:55.526741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25189): Launched 07:51:55.862404 run osmo-stp_10.42.42.5(pid=25190): Launched 07:51:55.990878 run osmo-msc_10.42.42.6: Starting osmo-msc 07:51:56.591204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25192): Launched 07:51:56.924676 run osmo-msc_10.42.42.6(pid=25193): Launched 07:51:57.112379 run osmo-stp_10.42.42.5(pid=25190): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25190)] 07:51:57.251917 run osmo-stp_10.42.42.5(pid=25190): stdout: | (launched: 2022-12-14_07:51:55.801272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:57.392097 run osmo-stp_10.42.42.5(pid=25190): stderr: | 20221214075155993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075155993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075155994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075155994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075155994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075155995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075155995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:57.530548 run osmo-stp_10.42.42.5(pid=25190): stdout: | (launched: 2022-12-14_07:51:55.801272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:57.662349 run osmo-stp_10.42.42.5(pid=25190): stderr: | 20221214075155993 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075155993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075155994 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075155994 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075155994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075155995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075155995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:57.819825 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25190): Process ended prematurely: osmo-stp_10.42.42.5(pid=25190) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25190)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:51:57.829849 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:51:57.858227 run osmo-hlr_10.42.42.2(pid=25187): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25187)] 07:51:57.909794 run osmo-hlr_10.42.42.2(pid=25187): stdout: | (launched: 2022-12-14_07:51:54.760010) 07:51:57.962519 run osmo-hlr_10.42.42.2(pid=25187): stderr: | 20221214075154958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075154958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075154958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075154959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075154959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075154959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075154971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075154979 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075154979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075154979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:58.036060 run osmo-msc_10.42.42.6(pid=25193): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25193)] 07:51:58.086275 run osmo-msc_10.42.42.6(pid=25193): stdout: | (launched: 2022-12-14_07:51:56.863488) 07:51:58.139058 run osmo-msc_10.42.42.6(pid=25193): stderr: | 20221214075157184 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075157184 DLGLOBAL DEBUG validating counter group 0x7ff437c03c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075157184 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075157184 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075157185 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075157185 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075157186 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075157187 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075157187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075157187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:51:58.191747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25186): Terminating (SIGTERM) 07:51:58.234101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25189): Terminating (SIGTERM) 07:51:58.276657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25192): Terminating (SIGTERM) 07:51:58.319718 --- ParallelTerminationStrategy: PID 25186 died... 07:51:58.340608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25186): Terminated: ok {rc=0} 07:51:58.387843 --- ParallelTerminationStrategy: PID 25189 died... 07:51:58.408205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25189): Terminated: ok {rc=0} 07:51:58.455249 --- ParallelTerminationStrategy: PID 25192 died... 07:51:58.475581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25192): Terminated: ok {rc=0} 07:51:58.564461 bus /sierra_3: Setting Powered False 07:51:59.663432 bus /sierra_3: Setting Powered False 07:52:00.779689 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:52:01.944413 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:52:01.957783 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:52:02.032047 tst mo_mt_call_osmux.py: using LAC 39475 07:52:02.163679 tst mo_mt_call_osmux.py: using RAC 205 07:52:02.295611 tst mo_mt_call_osmux.py: using CellId 39475 07:52:02.425906 tst mo_mt_call_osmux.py: using BVCI 39476 07:52:02.539969 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:52:02.551517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:52:02.562715 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:52:02.573893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:52:02.585868 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:52:02.597653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:52:02.716232 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:52:02.835444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:03.317854 run create_hlr_db(pid=25195): Launched 07:52:03.446416 bus /sierra_2: Setting Powered False 07:52:04.508218 run create_hlr_db(pid=25195): Terminated: ok {rc=0} 07:52:04.961764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25197): Launched 07:52:05.297353 run osmo-hlr_10.42.42.2(pid=25198): Launched 07:52:05.423752 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:05.994851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25200): Launched 07:52:06.329479 run osmo-stp_10.42.42.5(pid=25201): Launched 07:52:06.457024 run osmo-msc_10.42.42.6: Starting osmo-msc 07:52:07.060285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25203): Launched 07:52:07.393973 run osmo-msc_10.42.42.6(pid=25204): Launched 07:52:07.579772 run osmo-stp_10.42.42.5(pid=25201): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25201)] 07:52:07.718910 run osmo-stp_10.42.42.5(pid=25201): stdout: | (launched: 2022-12-14_07:52:06.267810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:07.859150 run osmo-stp_10.42.42.5(pid=25201): stderr: | 20221214075206462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075206462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075206462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075206463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075206463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075206463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075206463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:07.997186 run osmo-stp_10.42.42.5(pid=25201): stdout: | (launched: 2022-12-14_07:52:06.267810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:08.129211 run osmo-stp_10.42.42.5(pid=25201): stderr: | 20221214075206462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075206462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075206462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075206463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075206463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075206463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075206463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:08.286704 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25201): Process ended prematurely: osmo-stp_10.42.42.5(pid=25201) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25201)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:52:08.296398 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:52:08.324716 run osmo-hlr_10.42.42.2(pid=25198): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25198)] 07:52:08.376464 run osmo-hlr_10.42.42.2(pid=25198): stdout: | (launched: 2022-12-14_07:52:05.236063) 07:52:08.429282 run osmo-hlr_10.42.42.2(pid=25198): stderr: | 20221214075205434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075205434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075205434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075205434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075205434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075205434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075205484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075205494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075205494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075205494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:08.502601 run osmo-msc_10.42.42.6(pid=25204): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25204)] 07:52:08.552893 run osmo-msc_10.42.42.6(pid=25204): stdout: | (launched: 2022-12-14_07:52:07.332354) 07:52:08.605657 run osmo-msc_10.42.42.6(pid=25204): stderr: | 20221214075207656 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075207656 DLGLOBAL DEBUG validating counter group 0x7feb081c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075207656 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075207656 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075207656 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075207656 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075207658 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075207658 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075207659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075207659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:52:08.658259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25197): Terminating (SIGTERM) 07:52:08.700247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25200): Terminating (SIGTERM) 07:52:08.743044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25203): Terminating (SIGTERM) 07:52:08.785817 --- ParallelTerminationStrategy: PID 25197 died... 07:52:08.806566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25197): Terminated: ok {rc=0} 07:52:08.853729 --- ParallelTerminationStrategy: PID 25200 died... 07:52:08.874114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25200): Terminated: ok {rc=0} 07:52:08.921081 --- ParallelTerminationStrategy: PID 25203 died... 07:52:08.941444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25203): Terminated: ok {rc=0} 07:52:09.031226 bus /sierra_3: Setting Powered False 07:52:10.131174 bus /sierra_3: Setting Powered False 07:52:11.248005 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:52:12.501356 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:52:12.508770 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:52:12.538893 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:52:12.567680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:52:12.623393 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:52:12.652475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:52:12.678952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:52:13.234249 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:52:13.283594 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:13.294871 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:52:13.361024 tst mo_mt_call.py: using LAC 39476 07:52:13.484606 tst mo_mt_call.py: using RAC 206 07:52:13.607412 tst mo_mt_call.py: using CellId 39476 07:52:13.730593 tst mo_mt_call.py: using BVCI 39477 07:52:13.843185 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:13.854515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:13.865708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:13.876689 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:13.887880 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:13.898888 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:52:14.021425 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:52:14.144904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:14.661499 run create_hlr_db(pid=25210): Launched 07:52:14.793424 bus /sierra_2: Setting Powered False 07:52:15.877462 run create_hlr_db(pid=25210): Terminated: ok {rc=0} 07:52:16.351769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25212): Launched 07:52:16.713397 run osmo-hlr_10.42.42.2(pid=25213): Launched 07:52:16.966225 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:17.635368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25215): Launched 07:52:17.971653 run osmo-stp_10.42.42.5(pid=25216): Launched 07:52:18.099081 run osmo-msc_10.42.42.6: Starting osmo-msc 07:52:18.700051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25218): Launched 07:52:19.035849 run osmo-msc_10.42.42.6(pid=25219): Launched 07:52:19.223877 run osmo-stp_10.42.42.5(pid=25216): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25216)] 07:52:19.363221 run osmo-stp_10.42.42.5(pid=25216): stdout: | (launched: 2022-12-14_07:52:17.910241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:19.503662 run osmo-stp_10.42.42.5(pid=25216): stderr: | 20221214075218102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075218102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075218102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075218102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075218103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075218103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075218103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:19.642109 run osmo-stp_10.42.42.5(pid=25216): stdout: | (launched: 2022-12-14_07:52:17.910241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:19.773618 run osmo-stp_10.42.42.5(pid=25216): stderr: | 20221214075218102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075218102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075218102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075218102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075218103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075218103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075218103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:19.931438 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25216): Process ended prematurely: osmo-stp_10.42.42.5(pid=25216) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25216)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:52:19.941346 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 07:52:19.969363 run osmo-hlr_10.42.42.2(pid=25213): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25213)] 07:52:20.019955 run osmo-hlr_10.42.42.2(pid=25213): stdout: | (launched: 2022-12-14_07:52:16.654522) 07:52:20.072372 run osmo-hlr_10.42.42.2(pid=25213): stderr: | 20221214075216905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075216905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075216905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075216905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075216905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075216905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075216953 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075216974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075216974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075216974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:20.144693 run osmo-msc_10.42.42.6(pid=25219): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25219)] 07:52:20.194379 run osmo-msc_10.42.42.6(pid=25219): stdout: | (launched: 2022-12-14_07:52:18.974628) 07:52:20.246118 run osmo-msc_10.42.42.6(pid=25219): stderr: | 20221214075219296 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075219296 DLGLOBAL DEBUG validating counter group 0x7f6eac00ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075219296 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075219296 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075219296 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075219296 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075219298 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075219299 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075219299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075219299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:52:20.298389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25212): Terminating (SIGTERM) 07:52:20.340149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25215): Terminating (SIGTERM) 07:52:20.381923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25218): Terminating (SIGTERM) 07:52:20.424157 --- ParallelTerminationStrategy: PID 25212 died... 07:52:20.444779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25212): Terminated: ok {rc=0} 07:52:20.491321 --- ParallelTerminationStrategy: PID 25215 died... 07:52:20.511127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25215): Terminated: ok {rc=0} 07:52:20.557646 --- ParallelTerminationStrategy: PID 25218 died... 07:52:20.578130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25218): Terminated: ok {rc=0} 07:52:20.667258 bus /sierra_3: Setting Powered False 07:52:21.766334 bus /sierra_3: Setting Powered False 07:52:22.881843 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:52:24.033427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:24.046536 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:52:24.117289 tst mo_mt_call_osmux.py: using LAC 39477 07:52:24.248033 tst mo_mt_call_osmux.py: using RAC 207 07:52:24.379874 tst mo_mt_call_osmux.py: using CellId 39477 07:52:24.509194 tst mo_mt_call_osmux.py: using BVCI 39478 07:52:24.629926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:24.642066 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:24.653877 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:24.665684 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:24.677805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:52:24.689784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:52:24.809918 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:52:24.932760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:25.449497 run create_hlr_db(pid=25221): Launched 07:52:25.578497 bus /sierra_2: Setting Powered False 07:52:26.643745 run create_hlr_db(pid=25221): Terminated: ok {rc=0} 07:52:27.088266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25223): Launched 07:52:27.399690 run osmo-hlr_10.42.42.2(pid=25224): Launched 07:52:27.519320 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:28.052023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25226): Launched 07:52:28.364468 run osmo-stp_10.42.42.5(pid=25227): Launched 07:52:28.484624 run osmo-msc_10.42.42.6: Starting osmo-msc 07:52:29.043880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25229): Launched 07:52:29.356277 run osmo-msc_10.42.42.6(pid=25230): Launched 07:52:29.531664 run osmo-stp_10.42.42.5(pid=25227): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25227)] 07:52:29.661718 run osmo-stp_10.42.42.5(pid=25227): stdout: | (launched: 2022-12-14_07:52:28.306596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:29.791463 run osmo-stp_10.42.42.5(pid=25227): stderr: | 20221214075228479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075228479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075228479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075228480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075228480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075228480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075228480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:29.919478 run osmo-stp_10.42.42.5(pid=25227): stdout: | (launched: 2022-12-14_07:52:28.306596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:30.040785 run osmo-stp_10.42.42.5(pid=25227): stderr: | 20221214075228479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075228479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075228479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075228480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075228480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075228480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075228480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:30.187419 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25227): Process ended prematurely: osmo-stp_10.42.42.5(pid=25227) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25227)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:52:30.196277 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:52:30.222889 run osmo-hlr_10.42.42.2(pid=25224): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25224)] 07:52:30.270351 run osmo-hlr_10.42.42.2(pid=25224): stdout: | (launched: 2022-12-14_07:52:27.342143) 07:52:30.319623 run osmo-hlr_10.42.42.2(pid=25224): stderr: | 20221214075227519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075227519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075227519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075227519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075227519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075227519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075227563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075227573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075227574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075227574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:30.388438 run osmo-msc_10.42.42.6(pid=25230): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25230)] 07:52:30.435888 run osmo-msc_10.42.42.6(pid=25230): stdout: | (launched: 2022-12-14_07:52:29.298722) 07:52:30.484889 run osmo-msc_10.42.42.6(pid=25230): stderr: | 20221214075229573 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075229573 DLGLOBAL DEBUG validating counter group 0x7f9f9c456c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075229573 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075229573 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075229573 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075229573 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075229575 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075229576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075229576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075229576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:52:30.534256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25223): Terminating (SIGTERM) 07:52:30.573814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25226): Terminating (SIGTERM) 07:52:30.613261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25229): Terminating (SIGTERM) 07:52:30.653542 --- ParallelTerminationStrategy: PID 25223 died... 07:52:30.672553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25223): Terminated: ok {rc=0} 07:52:30.716472 --- ParallelTerminationStrategy: PID 25226 died... 07:52:30.734988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25226): Terminated: ok {rc=0} 07:52:30.778308 --- ParallelTerminationStrategy: PID 25229 died... 07:52:30.796875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25229): Terminated: ok {rc=0} 07:52:30.901467 bus /sierra_3: Setting Powered False 07:52:32.004350 bus /sierra_3: Setting Powered False 07:52:33.124688 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:52:34.376137 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:52:34.382591 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:52:34.411595 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:52:34.438133 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:52:34.488166 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:52:34.517537 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:52:34.544379 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:52:35.097700 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:52:35.148680 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:35.160369 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:52:35.226324 tst mo_mt_call.py: using LAC 39478 07:52:35.346529 tst mo_mt_call.py: using RAC 208 07:52:35.467951 tst mo_mt_call.py: using CellId 39478 07:52:35.589692 tst mo_mt_call.py: using BVCI 39479 07:52:35.701654 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:35.713186 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:35.724406 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:35.735695 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:35.747474 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:35.759236 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:52:35.883567 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:52:36.003805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:36.484916 run create_hlr_db(pid=25237): Launched 07:52:36.613190 bus /sierra_2: Setting Powered False 07:52:37.674489 run create_hlr_db(pid=25237): Terminated: ok {rc=0} 07:52:38.128674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25239): Launched 07:52:38.464433 run osmo-hlr_10.42.42.2(pid=25240): Launched 07:52:38.591968 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:39.171040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25242): Launched 07:52:39.503819 run osmo-stp_10.42.42.5(pid=25243): Launched 07:52:39.632821 run osmo-msc_10.42.42.6: Starting osmo-msc 07:52:40.235681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25245): Launched 07:52:40.569217 run osmo-msc_10.42.42.6(pid=25246): Launched 07:52:40.754857 run osmo-stp_10.42.42.5(pid=25243): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25243)] 07:52:40.895598 run osmo-stp_10.42.42.5(pid=25243): stdout: | (launched: 2022-12-14_07:52:39.442595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:41.037174 run osmo-stp_10.42.42.5(pid=25243): stderr: | 20221214075239636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075239636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075239636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075239637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075239637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075239637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075239637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:41.175973 run osmo-stp_10.42.42.5(pid=25243): stdout: | (launched: 2022-12-14_07:52:39.442595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:41.307611 run osmo-stp_10.42.42.5(pid=25243): stderr: | 20221214075239636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075239636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075239636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075239637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075239637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075239637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075239637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:41.465647 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25243): Process ended prematurely: osmo-stp_10.42.42.5(pid=25243) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25243)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:52:41.475175 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:52:41.503243 run osmo-hlr_10.42.42.2(pid=25240): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25240)] 07:52:41.554157 run osmo-hlr_10.42.42.2(pid=25240): stdout: | (launched: 2022-12-14_07:52:38.402831) 07:52:41.606625 run osmo-hlr_10.42.42.2(pid=25240): stderr: | 20221214075238603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075238603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075238603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075238603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075238603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075238603 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075238623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075238632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075238632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075238632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:41.679415 run osmo-msc_10.42.42.6(pid=25246): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25246)] 07:52:41.729244 run osmo-msc_10.42.42.6(pid=25246): stdout: | (launched: 2022-12-14_07:52:40.507612) 07:52:41.781657 run osmo-msc_10.42.42.6(pid=25246): stderr: | 20221214075240830 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075240831 DLGLOBAL DEBUG validating counter group 0x7fee13f80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075240831 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075240831 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075240831 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075240831 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075240833 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075240833 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075240833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075240833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:52:41.834303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25239): Terminating (SIGTERM) 07:52:41.876008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25242): Terminating (SIGTERM) 07:52:41.918660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25245): Terminating (SIGTERM) 07:52:41.961316 --- ParallelTerminationStrategy: PID 25239 died... 07:52:41.981824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25239): Terminated: ok {rc=0} 07:52:42.028547 --- ParallelTerminationStrategy: PID 25242 died... 07:52:42.048573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25242): Terminated: ok {rc=0} 07:52:42.095327 --- ParallelTerminationStrategy: PID 25245 died... 07:52:42.115434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25245): Terminated: ok {rc=0} 07:52:42.203966 bus /sierra_3: Setting Powered False 07:52:43.303440 bus /sierra_3: Setting Powered False 07:52:44.420128 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:52:45.570741 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:45.583477 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:52:45.653114 tst mo_mt_call_osmux.py: using LAC 39479 07:52:45.783826 tst mo_mt_call_osmux.py: using RAC 209 07:52:45.935134 tst mo_mt_call_osmux.py: using CellId 39479 07:52:46.063710 tst mo_mt_call_osmux.py: using BVCI 39480 07:52:46.188490 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:46.201682 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:46.214696 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:46.227644 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:46.241699 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:52:46.256334 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:52:46.384809 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:52:46.515748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:47.058603 run create_hlr_db(pid=25248): Launched 07:52:47.218987 bus /sierra_2: Setting Powered False 07:52:48.280659 run create_hlr_db(pid=25248): Terminated: ok {rc=0} 07:52:48.734572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25250): Launched 07:52:49.070246 run osmo-hlr_10.42.42.2(pid=25251): Launched 07:52:49.199217 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:49.775843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25253): Launched 07:52:50.112104 run osmo-stp_10.42.42.5(pid=25254): Launched 07:52:50.240932 run osmo-msc_10.42.42.6: Starting osmo-msc 07:52:50.842218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25256): Launched 07:52:51.178694 run osmo-msc_10.42.42.6(pid=25257): Launched 07:52:51.364620 run osmo-stp_10.42.42.5(pid=25254): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25254)] 07:52:51.504065 run osmo-stp_10.42.42.5(pid=25254): stdout: | (launched: 2022-12-14_07:52:50.050240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:51.644086 run osmo-stp_10.42.42.5(pid=25254): stderr: | 20221214075250246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075250246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075250246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075250246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075250247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075250247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075250247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:51.782437 run osmo-stp_10.42.42.5(pid=25254): stdout: | (launched: 2022-12-14_07:52:50.050240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:51.913955 run osmo-stp_10.42.42.5(pid=25254): stderr: | 20221214075250246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075250246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075250246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075250246 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075250247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075250247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075250247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:52.073082 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25254): Process ended prematurely: osmo-stp_10.42.42.5(pid=25254) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25254)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:52:52.082858 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 07:52:52.111309 run osmo-hlr_10.42.42.2(pid=25251): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25251)] 07:52:52.162230 run osmo-hlr_10.42.42.2(pid=25251): stdout: | (launched: 2022-12-14_07:52:49.008448) 07:52:52.214527 run osmo-hlr_10.42.42.2(pid=25251): stderr: | 20221214075249208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075249208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075249208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075249208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075249208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075249208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075249220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075249229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075249230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075249230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:52.287510 run osmo-msc_10.42.42.6(pid=25257): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25257)] 07:52:52.337894 run osmo-msc_10.42.42.6(pid=25257): stdout: | (launched: 2022-12-14_07:52:51.116925) 07:52:52.390346 run osmo-msc_10.42.42.6(pid=25257): stderr: | 20221214075251437 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075251438 DLGLOBAL DEBUG validating counter group 0x7fce5226ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075251438 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075251438 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075251438 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075251438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075251440 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075251440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075251440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075251440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:52:52.442624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25250): Terminating (SIGTERM) 07:52:52.484680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25253): Terminating (SIGTERM) 07:52:52.527241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25256): Terminating (SIGTERM) 07:52:52.569769 --- ParallelTerminationStrategy: PID 25250 died... 07:52:52.590313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25250): Terminated: ok {rc=0} 07:52:52.636924 --- ParallelTerminationStrategy: PID 25253 died... 07:52:52.657450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25253): Terminated: ok {rc=0} 07:52:52.703959 --- ParallelTerminationStrategy: PID 25256 died... 07:52:52.724032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25256): Terminated: ok {rc=0} 07:52:52.814139 bus /sierra_3: Setting Powered False 07:52:53.914132 bus /sierra_3: Setting Powered False 07:52:55.030499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:52:56.285124 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:52:56.291510 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:52:56.321348 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:52:56.349037 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:52:56.402932 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:52:56.434004 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:52:56.461714 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:52:57.010840 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:52:57.065745 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:52:57.077954 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:52:57.146667 tst mo_mt_call.py: using LAC 39480 07:52:57.277261 tst mo_mt_call.py: using RAC 210 07:52:57.408156 tst mo_mt_call.py: using CellId 39480 07:52:57.540517 tst mo_mt_call.py: using BVCI 39481 07:52:57.662236 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:52:57.673969 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:52:57.685598 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:52:57.697204 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:52:57.708939 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:52:57.720836 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:52:57.839927 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:52:57.962916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:58.479212 run create_hlr_db(pid=25262): Launched 07:52:58.606832 bus /sierra_2: Setting Powered False 07:52:59.672654 run create_hlr_db(pid=25262): Terminated: ok {rc=0} 07:53:00.136136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25265): Launched 07:53:00.471574 run osmo-hlr_10.42.42.2(pid=25266): Launched 07:53:00.600054 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:01.204366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25268): Launched 07:53:01.561770 run osmo-stp_10.42.42.5(pid=25269): Launched 07:53:01.691186 run osmo-msc_10.42.42.6: Starting osmo-msc 07:53:02.474487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25271): Launched 07:53:02.810087 run osmo-msc_10.42.42.6(pid=25272): Launched 07:53:02.996840 run osmo-stp_10.42.42.5(pid=25269): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25269)] 07:53:03.136050 run osmo-stp_10.42.42.5(pid=25269): stdout: | (launched: 2022-12-14_07:53:01.495864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:03.275373 run osmo-stp_10.42.42.5(pid=25269): stderr: | 20221214075301827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075301827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075301828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075301828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075301829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075301829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075301829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:03.414065 run osmo-stp_10.42.42.5(pid=25269): stdout: | (launched: 2022-12-14_07:53:01.495864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:03.545919 run osmo-stp_10.42.42.5(pid=25269): stderr: | 20221214075301827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075301827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075301828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075301828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075301829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075301829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075301829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:03.704120 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25269): Process ended prematurely: osmo-stp_10.42.42.5(pid=25269) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25269)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:53:03.713989 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 07:53:03.742453 run osmo-hlr_10.42.42.2(pid=25266): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25266)] 07:53:03.793693 run osmo-hlr_10.42.42.2(pid=25266): stdout: | (launched: 2022-12-14_07:53:00.410469) 07:53:03.845791 run osmo-hlr_10.42.42.2(pid=25266): stderr: | 20221214075300607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075300607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075300607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075300607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075300607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075300607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075300620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075300629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075300630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075300630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:03.918632 run osmo-msc_10.42.42.6(pid=25272): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25272)] 07:53:03.968943 run osmo-msc_10.42.42.6(pid=25272): stdout: | (launched: 2022-12-14_07:53:02.748532) 07:53:04.021585 run osmo-msc_10.42.42.6(pid=25272): stderr: | 20221214075303074 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075303074 DLGLOBAL DEBUG validating counter group 0x7f55f4853c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075303074 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075303074 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075303074 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075303075 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075303076 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075303077 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075303077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075303077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:53:04.074577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25265): Terminating (SIGTERM) 07:53:04.117019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25268): Terminating (SIGTERM) 07:53:04.159605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25271): Terminating (SIGTERM) 07:53:04.202546 --- ParallelTerminationStrategy: PID 25265 died... 07:53:04.223325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25265): Terminated: ok {rc=0} 07:53:04.270340 --- ParallelTerminationStrategy: PID 25268 died... 07:53:04.290613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25268): Terminated: ok {rc=0} 07:53:04.337319 --- ParallelTerminationStrategy: PID 25271 died... 07:53:04.357485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25271): Terminated: ok {rc=0} 07:53:04.446919 bus /sierra_3: Setting Powered False 07:53:05.546477 bus /sierra_3: Setting Powered False 07:53:06.663711 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:53:07.815521 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:53:07.828139 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:53:07.898052 tst mo_mt_call_osmux.py: using LAC 39481 07:53:08.033373 tst mo_mt_call_osmux.py: using RAC 211 07:53:08.165420 tst mo_mt_call_osmux.py: using CellId 39481 07:53:08.286730 tst mo_mt_call_osmux.py: using BVCI 39482 07:53:08.398194 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:53:08.409606 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:53:08.420827 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:53:08.431989 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:53:08.443299 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:53:08.454273 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:53:08.574997 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:53:08.694086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:09.175575 run create_hlr_db(pid=25274): Launched 07:53:09.302463 bus /sierra_2: Setting Powered False 07:53:10.364054 run create_hlr_db(pid=25274): Terminated: ok {rc=0} 07:53:10.817722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25276): Launched 07:53:11.155818 run osmo-hlr_10.42.42.2(pid=25277): Launched 07:53:11.283899 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:11.854628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25279): Launched 07:53:12.187608 run osmo-stp_10.42.42.5(pid=25280): Launched 07:53:12.315633 run osmo-msc_10.42.42.6: Starting osmo-msc 07:53:12.916161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25282): Launched 07:53:13.250962 run osmo-msc_10.42.42.6(pid=25283): Launched 07:53:13.438882 run osmo-stp_10.42.42.5(pid=25280): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25280)] 07:53:13.579068 run osmo-stp_10.42.42.5(pid=25280): stdout: | (launched: 2022-12-14_07:53:12.126667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:13.720399 run osmo-stp_10.42.42.5(pid=25280): stderr: | 20221214075312318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075312319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075312319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075312319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075312320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075312320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075312320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:13.859606 run osmo-stp_10.42.42.5(pid=25280): stdout: | (launched: 2022-12-14_07:53:12.126667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:13.991109 run osmo-stp_10.42.42.5(pid=25280): stderr: | 20221214075312318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075312319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075312319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075312319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075312320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075312320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075312320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:14.149504 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25280): Process ended prematurely: osmo-stp_10.42.42.5(pid=25280) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25280)] [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:53:14.159164 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:53:14.187265 run osmo-hlr_10.42.42.2(pid=25277): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25277)] 07:53:14.238255 run osmo-hlr_10.42.42.2(pid=25277): stdout: | (launched: 2022-12-14_07:53:11.094299) 07:53:14.290947 run osmo-hlr_10.42.42.2(pid=25277): stderr: | 20221214075311293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075311293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075311293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075311293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075311293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075311293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075311305 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075311315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075311315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075311315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:14.364208 run osmo-msc_10.42.42.6(pid=25283): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25283)] 07:53:14.414457 run osmo-msc_10.42.42.6(pid=25283): stdout: | (launched: 2022-12-14_07:53:13.189763) 07:53:14.466627 run osmo-msc_10.42.42.6(pid=25283): stderr: | 20221214075313509 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075313510 DLGLOBAL DEBUG validating counter group 0x7f2afb02dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075313510 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075313510 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075313510 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075313510 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075313512 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075313512 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075313512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075313512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:53:14.519053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25276): Terminating (SIGTERM) 07:53:14.560844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25279): Terminating (SIGTERM) 07:53:14.603107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25282): Terminating (SIGTERM) 07:53:14.645973 --- ParallelTerminationStrategy: PID 25276 died... 07:53:14.666500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25276): Terminated: ok {rc=0} 07:53:14.713063 --- ParallelTerminationStrategy: PID 25279 died... 07:53:14.733091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25279): Terminated: ok {rc=0} 07:53:14.779270 --- ParallelTerminationStrategy: PID 25282 died... 07:53:14.799377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25282): Terminated: ok {rc=0} 07:53:14.887099 bus /sierra_3: Setting Powered False 07:53:15.984301 bus /sierra_3: Setting Powered False 07:53:17.114310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 07:53:18.367227 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:53:18.371874 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:53:18.401157 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 07:53:18.428158 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 07:53:18.513195 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:53:18.541937 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 07:53:18.568233 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 07:53:19.156703 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2401 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 07:53:19.162752 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:19.174219 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:53:19.219624 tst emergency_mo_mt_call.py: using LAC 39482 07:53:19.347681 tst emergency_mo_mt_call.py: using RAC 212 07:53:19.480739 tst emergency_mo_mt_call.py: using CellId 39482 07:53:19.598457 tst emergency_mo_mt_call.py: using BVCI 39483 07:53:19.708169 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:19.719305 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:19.730138 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:19.740849 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:19.751729 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:19.762443 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:53:19.883320 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:53:20.001743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:20.472687 run create_hlr_db(pid=25288): Launched 07:53:20.597621 bus /sierra_2: Setting Powered False 07:53:21.661784 run create_hlr_db(pid=25288): Terminated: ok {rc=0} 07:53:22.100136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25290): Launched 07:53:22.407679 run osmo-hlr_10.42.42.2(pid=25291): Launched 07:53:22.524785 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:23.060219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25293): Launched 07:53:23.366889 run osmo-stp_10.42.42.5(pid=25294): Launched 07:53:23.491831 tst emergency_mo_mt_call.py: using MSISDN 8572 07:53:23.645767 run osmo-msc_10.42.42.6: Starting osmo-msc 07:53:24.200247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25296): Launched 07:53:24.507108 run osmo-msc_10.42.42.6(pid=25297): Launched 07:53:24.679373 run osmo-stp_10.42.42.5(pid=25294): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25294)] 07:53:24.807340 run osmo-stp_10.42.42.5(pid=25294): stdout: | (launched: 2022-12-14_07:53:23.310376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:24.934539 run osmo-stp_10.42.42.5(pid=25294): stderr: | 20221214075323479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075323479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075323480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075323480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075323481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075323481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075323481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:25.060152 run osmo-stp_10.42.42.5(pid=25294): stdout: | (launched: 2022-12-14_07:53:23.310376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:25.181436 run osmo-stp_10.42.42.5(pid=25294): stderr: | 20221214075323479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075323479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075323480 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075323480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075323481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075323481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075323481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:25.325623 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25294): Process ended prematurely: osmo-stp_10.42.42.5(pid=25294) [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25294)] [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 07:53:25.334081 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 07:53:25.360502 run osmo-hlr_10.42.42.2(pid=25291): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25291)] 07:53:25.408401 run osmo-hlr_10.42.42.2(pid=25291): stdout: | (launched: 2022-12-14_07:53:22.350746) 07:53:25.457441 run osmo-hlr_10.42.42.2(pid=25291): stderr: | 20221214075322526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075322526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075322526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075322526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075322526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075322527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075322539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075322547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075322547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075322547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:25.525789 run osmo-msc_10.42.42.6(pid=25297): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25297)] 07:53:25.573168 run osmo-msc_10.42.42.6(pid=25297): stdout: | (launched: 2022-12-14_07:53:24.450270) 07:53:25.621951 run osmo-msc_10.42.42.6(pid=25297): stderr: | 20221214075324721 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075324721 DLGLOBAL DEBUG validating counter group 0x7f4351f95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075324721 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075324721 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075324721 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075324722 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075324723 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075324724 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075324724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075324724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:53:25.671157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25290): Terminating (SIGTERM) 07:53:25.710665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25293): Terminating (SIGTERM) 07:53:25.750236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25296): Terminating (SIGTERM) 07:53:25.790300 --- ParallelTerminationStrategy: PID 25290 died... 07:53:25.809611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25290): Terminated: ok {rc=0} 07:53:25.853585 --- ParallelTerminationStrategy: PID 25293 died... 07:53:25.872093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25293): Terminated: ok {rc=0} 07:53:25.916103 --- ParallelTerminationStrategy: PID 25296 died... 07:53:25.934929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25296): Terminated: ok {rc=0} 07:53:26.020594 bus /sierra_3: Setting Powered False 07:53:27.122466 bus /sierra_3: Setting Powered False 07:53:28.238551 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 07:53:29.325065 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:29.337244 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:53:29.386747 tst emergency_preemptive_call.py: using LAC 39483 07:53:29.505765 tst emergency_preemptive_call.py: using RAC 213 07:53:29.630502 tst emergency_preemptive_call.py: using CellId 39483 07:53:29.748886 tst emergency_preemptive_call.py: using BVCI 39484 07:53:29.858042 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:29.869336 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:29.880036 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:29.890823 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:29.901981 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:53:29.912685 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:53:30.034209 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:53:30.155292 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:53:30.274268 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:53:30.394393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:30.923193 run create_hlr_db(pid=25299): Launched 07:53:31.117810 bus /sierra_2: Setting Powered False 07:53:32.194633 run create_hlr_db(pid=25299): Terminated: ok {rc=0} 07:53:32.652726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25301): Launched 07:53:32.981769 run osmo-hlr_10.42.42.2(pid=25302): Launched 07:53:33.108482 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:33.676395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25304): Launched 07:53:34.004759 run osmo-stp_10.42.42.5(pid=25305): Launched 07:53:34.141523 tst emergency_preemptive_call.py: using MSISDN 8573 07:53:34.314981 run osmo-msc_10.42.42.6: Starting osmo-msc 07:53:34.899959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25307): Launched 07:53:35.229808 run osmo-msc_10.42.42.6(pid=25308): Launched 07:53:35.416059 run osmo-stp_10.42.42.5(pid=25305): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25305)] 07:53:35.555028 run osmo-stp_10.42.42.5(pid=25305): stdout: | (launched: 2022-12-14_07:53:33.944454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:35.694439 run osmo-stp_10.42.42.5(pid=25305): stderr: | 20221214075334137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075334137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075334137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075334138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075334139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075334139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075334139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:35.831452 run osmo-stp_10.42.42.5(pid=25305): stdout: | (launched: 2022-12-14_07:53:33.944454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:35.961400 run osmo-stp_10.42.42.5(pid=25305): stderr: | 20221214075334137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075334137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075334137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075334138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075334139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075334139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075334139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:36.118004 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25305): Process ended prematurely: osmo-stp_10.42.42.5(pid=25305) [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25305)] [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 07:53:36.126957 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 07:53:36.154899 run osmo-hlr_10.42.42.2(pid=25302): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25302)] 07:53:36.206085 run osmo-hlr_10.42.42.2(pid=25302): stdout: | (launched: 2022-12-14_07:53:32.921474) 07:53:36.258296 run osmo-hlr_10.42.42.2(pid=25302): stderr: | 20221214075333117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075333117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075333117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075333117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075333118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075333118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075333130 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075333138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075333139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075333139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:36.331104 run osmo-msc_10.42.42.6(pid=25308): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25308)] 07:53:36.380927 run osmo-msc_10.42.42.6(pid=25308): stdout: | (launched: 2022-12-14_07:53:35.168911) 07:53:36.433227 run osmo-msc_10.42.42.6(pid=25308): stderr: | 20221214075335488 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075335489 DLGLOBAL DEBUG validating counter group 0x7fc90a59cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075335489 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075335489 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075335489 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075335489 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075335491 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075335491 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075335492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075335492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:53:36.485633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25301): Terminating (SIGTERM) 07:53:36.527322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25304): Terminating (SIGTERM) 07:53:36.569417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25307): Terminating (SIGTERM) 07:53:36.611803 --- ParallelTerminationStrategy: PID 25301 died... 07:53:36.632430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25301): Terminated: ok {rc=0} 07:53:36.678987 --- ParallelTerminationStrategy: PID 25304 died... 07:53:36.698896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25304): Terminated: ok {rc=0} 07:53:36.745193 --- ParallelTerminationStrategy: PID 25307 died... 07:53:36.764907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25307): Terminated: ok {rc=0} 07:53:36.852542 bus /sierra_9: Setting Powered False 07:53:37.951733 bus /sierra_9: Setting Powered False 07:53:39.070168 bus /sierra_8: Setting Powered False 07:53:40.170769 bus /sierra_8: Setting Powered False 07:53:41.283219 bus /sierra_3: Setting Powered False 07:53:42.380524 bus /sierra_3: Setting Powered False 07:53:43.495706 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 07:53:44.770061 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:53:44.774944 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:53:44.804783 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 07:53:44.845837 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 07:53:44.937336 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:53:44.967921 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 07:53:45.007969 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 07:53:45.600206 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 07:53:45.655827 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:45.667093 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:53:45.713290 tst cs_paging_gprs_active.py: using LAC 39484 07:53:45.845135 tst cs_paging_gprs_active.py: using RAC 214 07:53:45.987739 tst cs_paging_gprs_active.py: using CellId 39484 07:53:46.110377 tst cs_paging_gprs_active.py: using BVCI 39485 07:53:46.236558 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:46.249214 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:46.261617 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:46.273970 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:46.287334 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:46.300686 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:46.314230 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:46.327051 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:46.340070 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:53:46.488334 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:53:46.641822 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:53:46.865289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:47.187024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25313): Launched 07:53:47.467385 run iperf3-srv_10.42.42.10(pid=25314): Launched 07:53:47.584470 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:53:47.792537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:48.104382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25315): Launched 07:53:48.376090 run iperf3-srv_10.42.42.10(pid=25316): Launched 07:53:48.494195 tst cs_paging_gprs_active.py:38: start network... 07:53:48.701409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:49.181245 run create_hlr_db(pid=25317): Launched 07:53:49.307941 bus /sierra_2: Setting Powered False 07:53:50.368755 run create_hlr_db(pid=25317): Terminated: ok {rc=0} 07:53:50.823120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25319): Launched 07:53:51.158325 run osmo-hlr_10.42.42.2(pid=25320): Launched 07:53:51.286136 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:51.858268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25322): Launched 07:53:52.191490 run osmo-stp_10.42.42.5(pid=25323): Launched 07:53:52.319616 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:52.892051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25325): Launched 07:53:53.022225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:53.305257 run patchelf(pid=25326): Launched 07:53:53.492765 run osmo-stp_10.42.42.5(pid=25323): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25323)] 07:53:53.634038 run osmo-stp_10.42.42.5(pid=25323): stdout: | (launched: 2022-12-14_07:53:52.130164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:53.776185 run osmo-stp_10.42.42.5(pid=25323): stderr: | 20221214075352321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075352321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075352321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075352322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075352322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075352322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075352323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:53.917954 run osmo-stp_10.42.42.5(pid=25323): stdout: | (launched: 2022-12-14_07:53:52.130164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:54.054003 run osmo-stp_10.42.42.5(pid=25323): stderr: | 20221214075352321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075352321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075352321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075352322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075352322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075352322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075352323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:54.215739 run patchelf(pid=25326): Terminating (SIGINT) 07:53:54.403756 run patchelf(pid=25326): Terminated: ok {rc=0} 07:53:54.539429 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25323): Process ended prematurely: osmo-stp_10.42.42.5(pid=25323) [trial-2401↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25323)] [trial-2401↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 07:53:54.550383 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 07:53:54.579623 run osmo-hlr_10.42.42.2(pid=25320): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25320)] 07:53:54.631275 run osmo-hlr_10.42.42.2(pid=25320): stdout: | (launched: 2022-12-14_07:53:51.096779) 07:53:54.683465 run osmo-hlr_10.42.42.2(pid=25320): stderr: | 20221214075351296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075351296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075351296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075351296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075351296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075351296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075351308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075351317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075351318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075351318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:54.736202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25313): Terminating (SIGTERM) 07:53:54.778461 run iperf3-srv_10.42.42.10(pid=25314): Terminating (SIGTERM) 07:53:54.820844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25315): Terminating (SIGTERM) 07:53:54.863454 run iperf3-srv_10.42.42.10(pid=25316): Terminating (SIGTERM) 07:53:54.905943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25319): Terminating (SIGTERM) 07:53:54.948436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25322): Terminating (SIGTERM) 07:53:54.990972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25325): Terminating (SIGTERM) 07:53:55.033742 --- ParallelTerminationStrategy: PID 25313 died... 07:53:55.054562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25313): Terminated: ok {rc=0} 07:53:55.102051 --- ParallelTerminationStrategy: PID 25314 died... 07:53:55.122248 run iperf3-srv_10.42.42.10(pid=25314): Terminated {rc=256} 07:53:55.169190 --- ParallelTerminationStrategy: PID 25315 died... 07:53:55.189386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25315): Terminated: ok {rc=0} 07:53:55.235975 --- ParallelTerminationStrategy: PID 25316 died... 07:53:55.256046 run iperf3-srv_10.42.42.10(pid=25316): Terminated {rc=256} 07:53:55.302522 --- ParallelTerminationStrategy: PID 25319 died... 07:53:55.322593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25319): Terminated: ok {rc=0} 07:53:55.369457 --- ParallelTerminationStrategy: PID 25322 died... 07:53:55.389850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25322): Terminated: ok {rc=0} 07:53:55.436590 --- ParallelTerminationStrategy: PID 25325 died... 07:53:55.456717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25325): Terminated: ok {rc=0} 07:53:55.546880 bus /gobi_0: Setting Powered False 07:53:56.646762 bus /gobi_0: Setting Powered False 07:53:57.762612 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 07:53:58.914393 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:58.926438 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:53:58.974670 tst iperf3.py: using LAC 39485 07:53:59.106487 tst iperf3.py: using RAC 215 07:53:59.238438 tst iperf3.py: using CellId 39485 07:53:59.368839 tst iperf3.py: using BVCI 39486 07:53:59.482875 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:59.494129 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:59.505023 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:59.515872 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:59.526695 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:59.537327 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:59.548246 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:59.558929 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:53:59.569748 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:53:59.687444 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:53:59.895721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:00.207380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25327): Launched 07:54:00.479664 run iperf3-srv_10.42.42.10(pid=25328): Launched 07:54:00.597466 tst iperf3.py:8: start network... 07:54:00.804609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:01.320692 run create_hlr_db(pid=25329): Launched 07:54:01.492251 bus /gobi_6: Setting Powered False 07:54:02.583825 run create_hlr_db(pid=25329): Terminated: ok {rc=0} 07:54:03.218801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25477): Launched 07:54:03.668769 run osmo-hlr_10.42.42.2(pid=25536): Launched 07:54:03.967154 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:04.696547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25604): Launched 07:54:05.026748 run osmo-stp_10.42.42.5(pid=25605): Launched 07:54:05.266748 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:05.950527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25607): Launched 07:54:06.087818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:06.377762 run patchelf(pid=25610): Launched 07:54:06.562757 run osmo-stp_10.42.42.5(pid=25605): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25605)] 07:54:06.695511 run osmo-stp_10.42.42.5(pid=25605): stdout: | (launched: 2022-12-14_07:54:04.967386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:06.831855 run osmo-stp_10.42.42.5(pid=25605): stderr: | 20221214075405291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075405291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075405291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075405292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075405292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075405292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075405292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:06.969664 run osmo-stp_10.42.42.5(pid=25605): stdout: | (launched: 2022-12-14_07:54:04.967386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:07.098268 run osmo-stp_10.42.42.5(pid=25605): stderr: | 20221214075405291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075405291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075405291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075405292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075405292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075405292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075405292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:07.250679 run patchelf(pid=25610): Terminating (SIGINT) 07:54:07.429257 run patchelf(pid=25610): Terminated: ok {rc=0} 07:54:07.559481 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25605): Process ended prematurely: osmo-stp_10.42.42.5(pid=25605) [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25605)] [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 07:54:07.570219 tst iperf3.py:8: Test FAILED (8.7 sec) 07:54:07.599088 run osmo-hlr_10.42.42.2(pid=25536): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25536)] 07:54:07.648813 run osmo-hlr_10.42.42.2(pid=25536): stdout: | (launched: 2022-12-14_07:54:03.595443) 07:54:07.700245 run osmo-hlr_10.42.42.2(pid=25536): stderr: | 20221214075403939 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075403939 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075403939 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075403939 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075403939 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075403939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075403955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075403971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075403977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075403977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:07.752322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25327): Terminating (SIGTERM) 07:54:07.794466 run iperf3-srv_10.42.42.10(pid=25328): Terminating (SIGTERM) 07:54:07.839157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25477): Terminating (SIGTERM) 07:54:07.881677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25604): Terminating (SIGTERM) 07:54:07.925229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25607): Terminating (SIGTERM) 07:54:07.969152 --- ParallelTerminationStrategy: PID 25327 died... 07:54:07.989868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25327): Terminated: ok {rc=0} 07:54:08.037175 --- ParallelTerminationStrategy: PID 25328 died... 07:54:08.057111 run iperf3-srv_10.42.42.10(pid=25328): Terminated {rc=256} 07:54:08.102678 --- ParallelTerminationStrategy: PID 25477 died... 07:54:08.122730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25477): Terminated: ok {rc=0} 07:54:08.168444 --- ParallelTerminationStrategy: PID 25604 died... 07:54:08.188471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25604): Terminated: ok {rc=0} 07:54:08.233773 --- ParallelTerminationStrategy: PID 25607 died... 07:54:08.253674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25607): Terminated: ok {rc=0} 07:54:08.340419 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 07:54:09.489878 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:09.502340 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:54:09.548152 tst iperf3m4.py: using LAC 39486 07:54:09.675980 tst iperf3m4.py: using RAC 216 07:54:09.808923 tst iperf3m4.py: using CellId 39486 07:54:09.932591 tst iperf3m4.py: using BVCI 39487 07:54:10.050627 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:10.062779 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:10.074628 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:10.086514 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:10.098605 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:10.110508 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:10.122756 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:10.134689 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:10.146837 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:54:10.270232 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:54:10.395256 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:54:10.517373 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:54:10.643988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:54:10.858828 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:11.181780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25611): Launched 07:54:11.473439 run iperf3-srv_10.42.42.10(pid=25612): Launched 07:54:11.609741 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:54:11.824822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:12.146273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25613): Launched 07:54:12.438049 run iperf3-srv_10.42.42.10(pid=25614): Launched 07:54:12.574686 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:54:12.788211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:13.110380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25615): Launched 07:54:13.415481 run iperf3-srv_10.42.42.10(pid=25616): Launched 07:54:13.557836 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:54:13.787366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:14.129623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25617): Launched 07:54:14.435426 run iperf3-srv_10.42.42.10(pid=25618): Launched 07:54:14.577477 tst iperf3m4.py:8: start network... 07:54:14.806875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:15.333538 run create_hlr_db(pid=25619): Launched 07:54:15.497047 bus /gobi_6: Setting Powered False 07:54:16.598934 run create_hlr_db(pid=25619): Terminated: ok {rc=0} 07:54:17.187521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25621): Launched 07:54:17.608507 run osmo-hlr_10.42.42.2(pid=25622): Launched 07:54:17.893981 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:18.658006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25624): Launched 07:54:19.006543 run osmo-stp_10.42.42.5(pid=25625): Launched 07:54:19.252261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:19.916348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25627): Launched 07:54:20.057930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:20.342207 run patchelf(pid=25628): Launched 07:54:20.542947 run osmo-stp_10.42.42.5(pid=25625): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25625)] 07:54:20.686325 run osmo-stp_10.42.42.5(pid=25625): stdout: | (launched: 2022-12-14_07:54:18.943858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:20.832607 run osmo-stp_10.42.42.5(pid=25625): stderr: | 20221214075419242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075419242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075419242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075419243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075419243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075419243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075419243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:20.978946 run osmo-stp_10.42.42.5(pid=25625): stdout: | (launched: 2022-12-14_07:54:18.943858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:21.119909 run osmo-stp_10.42.42.5(pid=25625): stderr: | 20221214075419242 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075419242 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075419242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075419243 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075419243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075419243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075419243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:21.283817 run patchelf(pid=25628): Terminating (SIGINT) 07:54:21.475818 run patchelf(pid=25628): Terminated: ok {rc=0} 07:54:21.614525 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25625): Process ended prematurely: osmo-stp_10.42.42.5(pid=25625) [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25625)] [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 07:54:21.626378 tst iperf3m4.py:8: Test FAILED (12.2 sec) 07:54:21.658046 run osmo-hlr_10.42.42.2(pid=25622): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25622)] 07:54:21.712926 run osmo-hlr_10.42.42.2(pid=25622): stdout: | (launched: 2022-12-14_07:54:17.533825) 07:54:21.769201 run osmo-hlr_10.42.42.2(pid=25622): stderr: | 20221214075417850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075417850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075417850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075417850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075417850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075417850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075417864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075417889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075417889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075417889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:21.825537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25611): Terminating (SIGTERM) 07:54:21.868935 run iperf3-srv_10.42.42.10(pid=25612): Terminating (SIGTERM) 07:54:21.914969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25613): Terminating (SIGTERM) 07:54:21.959933 run iperf3-srv_10.42.42.10(pid=25614): Terminating (SIGTERM) 07:54:22.007747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25615): Terminating (SIGTERM) 07:54:22.053035 run iperf3-srv_10.42.42.10(pid=25616): Terminating (SIGTERM) 07:54:22.100995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25617): Terminating (SIGTERM) 07:54:22.146107 run iperf3-srv_10.42.42.10(pid=25618): Terminating (SIGTERM) 07:54:22.194066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25621): Terminating (SIGTERM) 07:54:22.239322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25624): Terminating (SIGTERM) 07:54:22.286377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25627): Terminating (SIGTERM) 07:54:22.333601 --- ParallelTerminationStrategy: PID 25611 died... 07:54:22.356106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25611): Terminated: ok {rc=0} 07:54:22.408175 --- ParallelTerminationStrategy: PID 25612 died... 07:54:22.429290 run iperf3-srv_10.42.42.10(pid=25612): Terminated {rc=256} 07:54:22.478450 --- ParallelTerminationStrategy: PID 25613 died... 07:54:22.500221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25613): Terminated: ok {rc=0} 07:54:22.549158 --- ParallelTerminationStrategy: PID 25614 died... 07:54:22.570548 run iperf3-srv_10.42.42.10(pid=25614): Terminated {rc=256} 07:54:22.621785 --- ParallelTerminationStrategy: PID 25615 died... 07:54:22.642524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25615): Terminated: ok {rc=0} 07:54:22.691598 --- ParallelTerminationStrategy: PID 25616 died... 07:54:22.713293 run iperf3-srv_10.42.42.10(pid=25616): Terminated {rc=256} 07:54:22.764202 --- ParallelTerminationStrategy: PID 25617 died... 07:54:22.786280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25617): Terminated: ok {rc=0} 07:54:22.835233 --- ParallelTerminationStrategy: PID 25618 died... 07:54:22.856935 run iperf3-srv_10.42.42.10(pid=25618): Terminated {rc=256} 07:54:22.906247 --- ParallelTerminationStrategy: PID 25621 died... 07:54:22.927849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25621): Terminated: ok {rc=0} 07:54:22.980754 --- ParallelTerminationStrategy: PID 25624 died... 07:54:23.001841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25624): Terminated: ok {rc=0} 07:54:23.050652 --- ParallelTerminationStrategy: PID 25627 died... 07:54:23.072595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25627): Terminated: ok {rc=0} 07:54:23.166194 bus /gobi_4: Setting Powered False 07:54:24.271879 bus /gobi_4: Setting Powered False 07:54:25.397859 bus /gobi_1: Setting Powered False 07:54:26.497951 bus /gobi_1: Setting Powered False 07:54:27.615890 bus /gobi_0: Setting Powered False 07:54:28.713563 bus /gobi_0: Setting Powered False 07:54:29.829798 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 07:54:30.951880 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:30.963948 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:54:31.017492 tst ping.py: using LAC 39487 07:54:31.139469 tst ping.py: using RAC 217 07:54:31.287242 tst ping.py: using CellId 39487 07:54:31.410031 tst ping.py: using BVCI 39488 07:54:31.533551 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:31.546147 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:31.558574 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:31.571057 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:31.584692 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:31.598456 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:31.613333 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:31.626968 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:54:31.765551 tst ping.py:19: start network... 07:54:31.989059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:32.492281 run create_hlr_db(pid=25630): Launched 07:54:32.616691 bus /gobi_6: Setting Powered False 07:54:33.680817 run create_hlr_db(pid=25630): Terminated: ok {rc=0} 07:54:34.128645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25632): Launched 07:54:34.451407 run osmo-hlr_10.42.42.2(pid=25633): Launched 07:54:34.574106 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:35.128022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25635): Launched 07:54:35.450398 run osmo-stp_10.42.42.5(pid=25636): Launched 07:54:35.574724 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:36.127531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25638): Launched 07:54:36.252321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:36.523028 run patchelf(pid=25639): Launched 07:54:36.702520 run osmo-stp_10.42.42.5(pid=25636): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25636)] 07:54:36.837770 run osmo-stp_10.42.42.5(pid=25636): stdout: | (launched: 2022-12-14_07:54:35.391064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:36.975083 run osmo-stp_10.42.42.5(pid=25636): stderr: | 20221214075435583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075435583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075435583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075435584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075435584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075435584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075435585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:37.112441 run osmo-stp_10.42.42.5(pid=25636): stdout: | (launched: 2022-12-14_07:54:35.391064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:37.243130 run osmo-stp_10.42.42.5(pid=25636): stderr: | 20221214075435583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075435583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075435583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075435584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075435584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075435584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075435585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:37.397619 run patchelf(pid=25639): Terminating (SIGINT) 07:54:37.578588 run patchelf(pid=25639): Terminated: ok {rc=0} 07:54:37.709294 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25636): Process ended prematurely: osmo-stp_10.42.42.5(pid=25636) [trial-2401↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25636)] [trial-2401↪gprs:trx-lms-limenet-micro↪ping.py:22] 07:54:37.719023 tst ping.py:22: Test FAILED (6.8 sec) 07:54:37.746854 run osmo-hlr_10.42.42.2(pid=25633): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25633)] 07:54:37.797156 run osmo-hlr_10.42.42.2(pid=25633): stdout: | (launched: 2022-12-14_07:54:34.391997) 07:54:37.849465 run osmo-hlr_10.42.42.2(pid=25633): stderr: | 20221214075434590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075434590 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075434590 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075434590 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075434590 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075434590 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075434602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075434610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075434610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075434610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:37.901640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25632): Terminating (SIGTERM) 07:54:37.943228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25635): Terminating (SIGTERM) 07:54:37.985495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25638): Terminating (SIGTERM) 07:54:38.027720 --- ParallelTerminationStrategy: PID 25632 died... 07:54:38.048055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25632): Terminated: ok {rc=0} 07:54:38.094241 --- ParallelTerminationStrategy: PID 25635 died... 07:54:38.114181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25635): Terminated: ok {rc=0} 07:54:38.160223 --- ParallelTerminationStrategy: PID 25638 died... 07:54:38.179891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25638): Terminated: ok {rc=0} 07:54:38.269299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 07:54:39.357236 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:39.369488 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:54:39.416227 tst ping_idle_ping.py: using LAC 39488 07:54:39.544076 tst ping_idle_ping.py: using RAC 218 07:54:39.670845 tst ping_idle_ping.py: using CellId 39488 07:54:39.796437 tst ping_idle_ping.py: using BVCI 39489 07:54:39.913325 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:39.924524 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:39.935699 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:39.946767 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:39.958374 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:39.969878 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:39.981490 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:54:39.992744 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:54:40.109131 tst ping_idle_ping.py:24: start network... 07:54:40.311433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:40.780523 run create_hlr_db(pid=25640): Launched 07:54:40.904017 bus /gobi_6: Setting Powered False 07:54:41.964731 run create_hlr_db(pid=25640): Terminated: ok {rc=0} 07:54:42.385593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25642): Launched 07:54:42.689259 run osmo-hlr_10.42.42.2(pid=25643): Launched 07:54:42.804647 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:43.325469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25645): Launched 07:54:43.628941 run osmo-stp_10.42.42.5(pid=25646): Launched 07:54:43.744159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:44.263293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25648): Launched 07:54:44.378828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:44.632829 run patchelf(pid=25649): Launched 07:54:44.800583 run osmo-stp_10.42.42.5(pid=25646): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25646)] 07:54:44.927959 run osmo-stp_10.42.42.5(pid=25646): stdout: | (launched: 2022-12-14_07:54:43.572632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:45.056797 run osmo-stp_10.42.42.5(pid=25646): stderr: | 20221214075443742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075443742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075443742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075443743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075443743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075443743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075443743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:45.186010 run osmo-stp_10.42.42.5(pid=25646): stdout: | (launched: 2022-12-14_07:54:43.572632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:45.308325 run osmo-stp_10.42.42.5(pid=25646): stderr: | 20221214075443742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075443742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075443742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075443743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075443743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075443743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075443743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:45.453368 run patchelf(pid=25649): Terminating (SIGINT) 07:54:45.623301 run patchelf(pid=25649): Terminated: ok {rc=0} 07:54:45.746394 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25646): Process ended prematurely: osmo-stp_10.42.42.5(pid=25646) [trial-2401↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25646)] [trial-2401↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 07:54:45.755412 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:54:45.782282 run osmo-hlr_10.42.42.2(pid=25643): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25643)] 07:54:45.830857 run osmo-hlr_10.42.42.2(pid=25643): stdout: | (launched: 2022-12-14_07:54:42.632522) 07:54:45.907433 run osmo-hlr_10.42.42.2(pid=25643): stderr: | 20221214075442810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075442810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075442810 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075442810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075442810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075442810 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075442822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075442833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075442833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075442833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:45.958644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25642): Terminating (SIGTERM) 07:54:46.008102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25645): Terminating (SIGTERM) 07:54:46.061123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25648): Terminating (SIGTERM) 07:54:46.103886 --- ParallelTerminationStrategy: PID 25642 died... 07:54:46.123583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25642): Terminated: ok {rc=0} 07:54:46.168632 --- ParallelTerminationStrategy: PID 25645 died... 07:54:46.188270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25645): Terminated: ok {rc=0} 07:54:46.233251 --- ParallelTerminationStrategy: PID 25648 died... 07:54:46.252524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25648): Terminated: ok {rc=0} 07:54:46.339247 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 07:54:47.636534 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:54:47.642926 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:54:47.672746 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:54:47.715032 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:54:47.805958 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:54:47.836040 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:54:47.876057 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:54:48.470699 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:54:48.525151 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:54:48.536499 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:54:48.585095 tst cs_paging_gprs_active.py: using LAC 39489 07:54:48.707192 tst cs_paging_gprs_active.py: using RAC 219 07:54:48.837850 tst cs_paging_gprs_active.py: using CellId 39489 07:54:48.966243 tst cs_paging_gprs_active.py: using BVCI 39490 07:54:49.087784 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:54:49.099444 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:54:49.110804 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:54:49.122433 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:54:49.134078 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:54:49.145845 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:54:49.157658 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:54:49.169279 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:54:49.180925 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:54:49.300317 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:54:49.417646 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:54:49.623519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:49.932277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25653): Launched 07:54:50.200390 run iperf3-srv_10.42.42.10(pid=25654): Launched 07:54:50.315644 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:54:50.520156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:54:50.828703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25655): Launched 07:54:51.096770 run iperf3-srv_10.42.42.10(pid=25656): Launched 07:54:51.212239 tst cs_paging_gprs_active.py:38: start network... 07:54:51.417605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:51.895860 run create_hlr_db(pid=25657): Launched 07:54:52.022568 bus /gobi_6: Setting Powered False 07:54:53.083477 run create_hlr_db(pid=25657): Terminated: ok {rc=0} 07:54:53.531589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25659): Launched 07:54:53.862947 run osmo-hlr_10.42.42.2(pid=25660): Launched 07:54:53.990263 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:54.559121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25662): Launched 07:54:54.887453 run osmo-stp_10.42.42.5(pid=25663): Launched 07:54:55.014652 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:55.590654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25665): Launched 07:54:55.717169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:55.996014 run patchelf(pid=25666): Launched 07:54:56.181314 run osmo-stp_10.42.42.5(pid=25663): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25663)] 07:54:56.320122 run osmo-stp_10.42.42.5(pid=25663): stdout: | (launched: 2022-12-14_07:54:54.827172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:56.459996 run osmo-stp_10.42.42.5(pid=25663): stderr: | 20221214075455021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075455021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075455022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075455022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075455022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075455023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075455023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:56.600081 run osmo-stp_10.42.42.5(pid=25663): stdout: | (launched: 2022-12-14_07:54:54.827172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:56.734332 run osmo-stp_10.42.42.5(pid=25663): stderr: | 20221214075455021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075455021 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075455022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075455022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075455022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075455023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075455023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:56.893073 run patchelf(pid=25666): Terminating (SIGINT) 07:54:57.079072 run patchelf(pid=25666): Terminated: ok {rc=0} 07:54:57.213849 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25663): Process ended prematurely: osmo-stp_10.42.42.5(pid=25663) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25663)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:54:57.224164 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 07:54:57.252783 run osmo-hlr_10.42.42.2(pid=25660): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25660)] 07:54:57.303173 run osmo-hlr_10.42.42.2(pid=25660): stdout: | (launched: 2022-12-14_07:54:53.801991) 07:54:57.355431 run osmo-hlr_10.42.42.2(pid=25660): stderr: | 20221214075454001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075454001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075454001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075454001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075454001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075454002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075454015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075454023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075454023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075454023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:57.407824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25653): Terminating (SIGTERM) 07:54:57.449427 run iperf3-srv_10.42.42.10(pid=25654): Terminating (SIGTERM) 07:54:57.491515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25655): Terminating (SIGTERM) 07:54:57.533752 run iperf3-srv_10.42.42.10(pid=25656): Terminating (SIGTERM) 07:54:57.575531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25659): Terminating (SIGTERM) 07:54:57.617979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25662): Terminating (SIGTERM) 07:54:57.659764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25665): Terminating (SIGTERM) 07:54:57.702018 --- ParallelTerminationStrategy: PID 25653 died... 07:54:57.722295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25653): Terminated: ok {rc=0} 07:54:57.768582 --- ParallelTerminationStrategy: PID 25654 died... 07:54:57.788254 run iperf3-srv_10.42.42.10(pid=25654): Terminated {rc=256} 07:54:57.834093 --- ParallelTerminationStrategy: PID 25655 died... 07:54:57.854131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25655): Terminated: ok {rc=0} 07:54:57.900153 --- ParallelTerminationStrategy: PID 25656 died... 07:54:57.919780 run iperf3-srv_10.42.42.10(pid=25656): Terminated {rc=256} 07:54:57.965624 --- ParallelTerminationStrategy: PID 25659 died... 07:54:57.985332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25659): Terminated: ok {rc=0} 07:54:58.031221 --- ParallelTerminationStrategy: PID 25662 died... 07:54:58.050878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25662): Terminated: ok {rc=0} 07:54:58.097064 --- ParallelTerminationStrategy: PID 25665 died... 07:54:58.117219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25665): Terminated: ok {rc=0} 07:54:58.204681 bus /gobi_0: Setting Powered False 07:54:59.303566 bus /gobi_0: Setting Powered False 07:55:00.416703 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:55:01.576196 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:01.589908 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:55:01.643565 tst iperf3.py: using LAC 39490 07:55:01.773963 tst iperf3.py: using RAC 220 07:55:01.927853 tst iperf3.py: using CellId 39490 07:55:02.093051 tst iperf3.py: using BVCI 39491 07:55:02.216192 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:02.228929 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:02.241486 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:02.254181 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:02.267677 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:02.281338 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:02.295799 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:02.309040 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:02.321149 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:55:02.438769 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:55:02.644775 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:02.952338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25670): Launched 07:55:03.220300 run iperf3-srv_10.42.42.10(pid=25671): Launched 07:55:03.335378 tst iperf3.py:8: start network... 07:55:03.540315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:04.014595 run create_hlr_db(pid=25672): Launched 07:55:04.142744 bus /gobi_6: Setting Powered False 07:55:05.203372 run create_hlr_db(pid=25672): Terminated: ok {rc=0} 07:55:05.650941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25674): Launched 07:55:05.982326 run osmo-hlr_10.42.42.2(pid=25675): Launched 07:55:06.109798 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:06.678781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25677): Launched 07:55:07.009780 run osmo-stp_10.42.42.5(pid=25678): Launched 07:55:07.136654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:07.706033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25680): Launched 07:55:07.832432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:08.110464 run patchelf(pid=25681): Launched 07:55:08.294521 run osmo-stp_10.42.42.5(pid=25678): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25678)] 07:55:08.432722 run osmo-stp_10.42.42.5(pid=25678): stdout: | (launched: 2022-12-14_07:55:06.948856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:08.573050 run osmo-stp_10.42.42.5(pid=25678): stderr: | 20221214075507142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075507143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075507143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075507143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075507144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075507144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075507144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:08.713188 run osmo-stp_10.42.42.5(pid=25678): stdout: | (launched: 2022-12-14_07:55:06.948856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:08.846942 run osmo-stp_10.42.42.5(pid=25678): stderr: | 20221214075507142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075507143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075507143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075507143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075507144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075507144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075507144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:09.005415 run patchelf(pid=25681): Terminating (SIGINT) 07:55:09.190507 run patchelf(pid=25681): Terminated: ok {rc=0} 07:55:09.323500 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25678): Process ended prematurely: osmo-stp_10.42.42.5(pid=25678) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25678)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 07:55:09.333798 tst iperf3.py:8: Test FAILED (7.8 sec) 07:55:09.362473 run osmo-hlr_10.42.42.2(pid=25675): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25675)] 07:55:09.413213 run osmo-hlr_10.42.42.2(pid=25675): stdout: | (launched: 2022-12-14_07:55:05.920870) 07:55:09.465335 run osmo-hlr_10.42.42.2(pid=25675): stderr: | 20221214075506122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075506122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075506122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075506122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075506122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075506122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075506138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075506147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075506147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075506147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:09.517645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25670): Terminating (SIGTERM) 07:55:09.559366 run iperf3-srv_10.42.42.10(pid=25671): Terminating (SIGTERM) 07:55:09.601743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25674): Terminating (SIGTERM) 07:55:09.643683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25677): Terminating (SIGTERM) 07:55:09.685494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25680): Terminating (SIGTERM) 07:55:09.727608 --- ParallelTerminationStrategy: PID 25670 died... 07:55:09.747787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25670): Terminated: ok {rc=0} 07:55:09.794307 --- ParallelTerminationStrategy: PID 25671 died... 07:55:09.813946 run iperf3-srv_10.42.42.10(pid=25671): Terminated {rc=256} 07:55:09.859882 --- ParallelTerminationStrategy: PID 25674 died... 07:55:09.879428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25674): Terminated: ok {rc=0} 07:55:09.925297 --- ParallelTerminationStrategy: PID 25677 died... 07:55:09.944939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25677): Terminated: ok {rc=0} 07:55:09.991458 --- ParallelTerminationStrategy: PID 25680 died... 07:55:10.011336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25680): Terminated: ok {rc=0} 07:55:10.099147 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:55:11.251759 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:11.264147 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:55:11.313376 tst iperf3m4.py: using LAC 39491 07:55:11.442711 tst iperf3m4.py: using RAC 221 07:55:11.573664 tst iperf3m4.py: using CellId 39491 07:55:11.704389 tst iperf3m4.py: using BVCI 39492 07:55:11.824296 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:11.836010 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:11.847375 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:11.858883 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:11.871094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:11.883357 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:11.895768 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:11.907783 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:11.920105 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:55:12.050145 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:55:12.169830 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:55:12.292850 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:55:12.415123 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:55:12.637104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:12.967475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25682): Launched 07:55:13.258218 run iperf3-srv_10.42.42.10(pid=25683): Launched 07:55:13.383537 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:55:13.604861 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:13.934939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25684): Launched 07:55:14.225864 run iperf3-srv_10.42.42.10(pid=25685): Launched 07:55:14.350437 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:55:14.573211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:14.905210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25686): Launched 07:55:15.194488 run iperf3-srv_10.42.42.10(pid=25687): Launched 07:55:15.318075 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:55:15.539250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:15.873731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25688): Launched 07:55:16.202272 run iperf3-srv_10.42.42.10(pid=25689): Launched 07:55:16.335260 tst iperf3m4.py:8: start network... 07:55:16.547245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:17.057306 run create_hlr_db(pid=25690): Launched 07:55:17.219985 bus /gobi_6: Setting Powered False 07:55:18.284158 run create_hlr_db(pid=25690): Terminated: ok {rc=0} 07:55:18.724314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25692): Launched 07:55:19.031954 run osmo-hlr_10.42.42.2(pid=25693): Launched 07:55:19.148925 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:19.705516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25695): Launched 07:55:20.038713 run osmo-stp_10.42.42.5(pid=25696): Launched 07:55:20.166932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:20.733728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25698): Launched 07:55:20.861427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:21.139788 run patchelf(pid=25699): Launched 07:55:21.324757 run osmo-stp_10.42.42.5(pid=25696): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25696)] 07:55:21.463614 run osmo-stp_10.42.42.5(pid=25696): stdout: | (launched: 2022-12-14_07:55:19.977423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:21.603913 run osmo-stp_10.42.42.5(pid=25696): stderr: | 20221214075520171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075520171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075520171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075520171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075520172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075520172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075520172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:21.744333 run osmo-stp_10.42.42.5(pid=25696): stdout: | (launched: 2022-12-14_07:55:19.977423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:21.878509 run osmo-stp_10.42.42.5(pid=25696): stderr: | 20221214075520171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075520171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075520171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075520171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075520172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075520172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075520172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:22.037363 run patchelf(pid=25699): Terminating (SIGINT) 07:55:22.222676 run patchelf(pid=25699): Terminated: ok {rc=0} 07:55:22.356523 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25696): Process ended prematurely: osmo-stp_10.42.42.5(pid=25696) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25696)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 07:55:22.367056 tst iperf3m4.py:8: Test FAILED (11.2 sec) 07:55:22.395644 run osmo-hlr_10.42.42.2(pid=25693): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25693)] 07:55:22.446041 run osmo-hlr_10.42.42.2(pid=25693): stdout: | (launched: 2022-12-14_07:55:18.975109) 07:55:22.498136 run osmo-hlr_10.42.42.2(pid=25693): stderr: | 20221214075519150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075519150 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075519150 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075519150 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075519150 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075519150 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075519162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075519170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075519171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075519171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:22.550424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25682): Terminating (SIGTERM) 07:55:22.592086 run iperf3-srv_10.42.42.10(pid=25683): Terminating (SIGTERM) 07:55:22.634421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25684): Terminating (SIGTERM) 07:55:22.676267 run iperf3-srv_10.42.42.10(pid=25685): Terminating (SIGTERM) 07:55:22.718633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25686): Terminating (SIGTERM) 07:55:22.760562 run iperf3-srv_10.42.42.10(pid=25687): Terminating (SIGTERM) 07:55:22.802389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25688): Terminating (SIGTERM) 07:55:22.844401 run iperf3-srv_10.42.42.10(pid=25689): Terminating (SIGTERM) 07:55:22.886264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25692): Terminating (SIGTERM) 07:55:22.928113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25695): Terminating (SIGTERM) 07:55:22.970107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25698): Terminating (SIGTERM) 07:55:23.012699 --- ParallelTerminationStrategy: PID 25682 died... 07:55:23.032872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25682): Terminated: ok {rc=0} 07:55:23.079149 --- ParallelTerminationStrategy: PID 25683 died... 07:55:23.098837 run iperf3-srv_10.42.42.10(pid=25683): Terminated {rc=256} 07:55:23.145282 --- ParallelTerminationStrategy: PID 25684 died... 07:55:23.164906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25684): Terminated: ok {rc=0} 07:55:23.211137 --- ParallelTerminationStrategy: PID 25685 died... 07:55:23.230841 run iperf3-srv_10.42.42.10(pid=25685): Terminated {rc=256} 07:55:23.276916 --- ParallelTerminationStrategy: PID 25686 died... 07:55:23.296684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25686): Terminated: ok {rc=0} 07:55:23.342758 --- ParallelTerminationStrategy: PID 25687 died... 07:55:23.362520 run iperf3-srv_10.42.42.10(pid=25687): Terminated {rc=256} 07:55:23.408408 --- ParallelTerminationStrategy: PID 25688 died... 07:55:23.428210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25688): Terminated: ok {rc=0} 07:55:23.474219 --- ParallelTerminationStrategy: PID 25689 died... 07:55:23.494000 run iperf3-srv_10.42.42.10(pid=25689): Terminated {rc=256} 07:55:23.540008 --- ParallelTerminationStrategy: PID 25692 died... 07:55:23.559866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25692): Terminated: ok {rc=0} 07:55:23.605986 --- ParallelTerminationStrategy: PID 25695 died... 07:55:23.625794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25695): Terminated: ok {rc=0} 07:55:23.671776 --- ParallelTerminationStrategy: PID 25698 died... 07:55:23.691603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25698): Terminated: ok {rc=0} 07:55:23.779739 bus /gobi_4: Setting Powered False 07:55:24.881312 bus /gobi_4: Setting Powered False 07:55:25.997913 bus /gobi_1: Setting Powered False 07:55:27.097518 bus /gobi_1: Setting Powered False 07:55:28.212539 bus /gobi_0: Setting Powered False 07:55:29.310846 bus /gobi_0: Setting Powered False 07:55:30.428010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 07:55:31.529280 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:31.542307 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:55:31.590640 tst ping.py: using LAC 39492 07:55:31.715778 tst ping.py: using RAC 222 07:55:31.837433 tst ping.py: using CellId 39492 07:55:31.991393 tst ping.py: using BVCI 39493 07:55:32.148891 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:32.165471 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:32.182610 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:32.197242 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:32.220374 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:32.247692 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:32.260720 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:32.273312 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:55:32.398364 tst ping.py:19: start network... 07:55:32.599230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:33.063209 run create_hlr_db(pid=25700): Launched 07:55:33.186587 bus /gobi_6: Setting Powered False 07:55:34.246866 run create_hlr_db(pid=25700): Terminated: ok {rc=0} 07:55:34.688161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25702): Launched 07:55:35.013537 run osmo-hlr_10.42.42.2(pid=25703): Launched 07:55:35.139488 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:35.699434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25705): Launched 07:55:36.022339 run osmo-stp_10.42.42.5(pid=25706): Launched 07:55:36.147060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:36.704595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25708): Launched 07:55:36.828673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:37.102241 run patchelf(pid=25709): Launched 07:55:37.283838 run osmo-stp_10.42.42.5(pid=25706): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25706)] 07:55:37.420517 run osmo-stp_10.42.42.5(pid=25706): stdout: | (launched: 2022-12-14_07:55:35.962213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:37.558679 run osmo-stp_10.42.42.5(pid=25706): stderr: | 20221214075536157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075536157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075536157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075536158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075536158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075536158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075536158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:37.697063 run osmo-stp_10.42.42.5(pid=25706): stdout: | (launched: 2022-12-14_07:55:35.962213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:37.828399 run osmo-stp_10.42.42.5(pid=25706): stderr: | 20221214075536157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075536157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075536157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075536158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075536158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075536158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075536158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:37.982757 run patchelf(pid=25709): Terminating (SIGINT) 07:55:38.153555 run patchelf(pid=25709): Terminated: ok {rc=0} 07:55:38.277447 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25706): Process ended prematurely: osmo-stp_10.42.42.5(pid=25706) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25706)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 07:55:38.286677 tst ping.py:22: Test FAILED (6.8 sec) 07:55:38.313909 run osmo-hlr_10.42.42.2(pid=25703): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25703)] 07:55:38.361628 run osmo-hlr_10.42.42.2(pid=25703): stdout: | (launched: 2022-12-14_07:55:34.953983) 07:55:38.411046 run osmo-hlr_10.42.42.2(pid=25703): stderr: | 20221214075535152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075535152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075535152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075535152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075535152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075535152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075535164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075535173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075535173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075535173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:38.460917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25702): Terminating (SIGTERM) 07:55:38.500803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25705): Terminating (SIGTERM) 07:55:38.540424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25708): Terminating (SIGTERM) 07:55:38.580396 --- ParallelTerminationStrategy: PID 25702 died... 07:55:38.599765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25702): Terminated: ok {rc=0} 07:55:38.643985 --- ParallelTerminationStrategy: PID 25705 died... 07:55:38.662720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25705): Terminated: ok {rc=0} 07:55:38.706708 --- ParallelTerminationStrategy: PID 25708 died... 07:55:38.725548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25708): Terminated: ok {rc=0} 07:55:38.810502 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:55:39.898277 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:39.910284 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:55:39.958500 tst ping_idle_ping.py: using LAC 39493 07:55:40.079174 tst ping_idle_ping.py: using RAC 223 07:55:40.199623 tst ping_idle_ping.py: using CellId 39493 07:55:40.319777 tst ping_idle_ping.py: using BVCI 39494 07:55:40.439562 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:40.451600 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:40.463168 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:40.474893 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:40.486659 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:40.498577 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:40.510784 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:55:40.522483 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:55:40.643337 tst ping_idle_ping.py:24: start network... 07:55:40.861713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:41.365501 run create_hlr_db(pid=25710): Launched 07:55:41.490534 bus /gobi_6: Setting Powered False 07:55:42.554823 run create_hlr_db(pid=25710): Terminated: ok {rc=0} 07:55:43.006293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25712): Launched 07:55:43.330803 run osmo-hlr_10.42.42.2(pid=25713): Launched 07:55:43.456123 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:44.014080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25715): Launched 07:55:44.342077 run osmo-stp_10.42.42.5(pid=25716): Launched 07:55:44.467976 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:45.029970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25718): Launched 07:55:45.155308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:45.428912 run patchelf(pid=25719): Launched 07:55:45.610551 run osmo-stp_10.42.42.5(pid=25716): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25716)] 07:55:45.747596 run osmo-stp_10.42.42.5(pid=25716): stdout: | (launched: 2022-12-14_07:55:44.281864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:45.909728 run osmo-stp_10.42.42.5(pid=25716): stderr: | 20221214075544474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075544474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075544474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075544475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075544475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075544475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075544475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:46.061615 run osmo-stp_10.42.42.5(pid=25716): stdout: | (launched: 2022-12-14_07:55:44.281864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:46.188824 run osmo-stp_10.42.42.5(pid=25716): stderr: | 20221214075544474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075544474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075544474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075544475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075544475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075544475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075544475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:46.339549 run patchelf(pid=25719): Terminating (SIGINT) 07:55:46.515963 run patchelf(pid=25719): Terminated: ok {rc=0} 07:55:46.644568 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25716): Process ended prematurely: osmo-stp_10.42.42.5(pid=25716) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25716)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 07:55:46.654308 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:55:46.682503 run osmo-hlr_10.42.42.2(pid=25713): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25713)] 07:55:46.731465 run osmo-hlr_10.42.42.2(pid=25713): stdout: | (launched: 2022-12-14_07:55:43.271128) 07:55:46.783660 run osmo-hlr_10.42.42.2(pid=25713): stderr: | 20221214075543468 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075543468 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075543468 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075543469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075543469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075543469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075543482 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075543490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075543490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075543490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:46.834483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25712): Terminating (SIGTERM) 07:55:46.876321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25715): Terminating (SIGTERM) 07:55:46.919838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25718): Terminating (SIGTERM) 07:55:46.963303 --- ParallelTerminationStrategy: PID 25712 died... 07:55:46.983842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25712): Terminated: ok {rc=0} 07:55:47.030499 --- ParallelTerminationStrategy: PID 25715 died... 07:55:47.051277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25715): Terminated: ok {rc=0} 07:55:47.096673 --- ParallelTerminationStrategy: PID 25718 died... 07:55:47.115957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25718): Terminated: ok {rc=0} 07:55:47.203570 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:55:48.503566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:55:48.510292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:55:48.539734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:55:48.579114 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:55:48.667827 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:55:48.696498 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:55:48.735009 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:55:49.331077 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:55:49.380297 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:55:49.391611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:55:49.460250 tst cs_paging_gprs_active.py: using LAC 39494 07:55:49.590749 tst cs_paging_gprs_active.py: using RAC 224 07:55:49.719864 tst cs_paging_gprs_active.py: using CellId 39494 07:55:49.846598 tst cs_paging_gprs_active.py: using BVCI 39495 07:55:49.966229 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:55:49.977787 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:55:49.989113 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:55:50.000436 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:55:50.012198 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:55:50.023810 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:55:50.035602 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:55:50.047264 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:55:50.059075 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:55:50.181245 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:55:50.302025 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:55:50.509685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:50.819691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25724): Launched 07:55:51.089111 run iperf3-srv_10.42.42.10(pid=25725): Launched 07:55:51.205287 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:55:51.411065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:55:51.720183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25726): Launched 07:55:51.992334 run iperf3-srv_10.42.42.10(pid=25728): Launched 07:55:52.107941 tst cs_paging_gprs_active.py:38: start network... 07:55:52.314335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:52.791146 run create_hlr_db(pid=25730): Launched 07:55:52.919482 bus /gobi_6: Setting Powered False 07:55:53.980422 run create_hlr_db(pid=25730): Terminated: ok {rc=0} 07:55:54.432450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25732): Launched 07:55:54.765957 run osmo-hlr_10.42.42.2(pid=25733): Launched 07:55:54.892448 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:55.463955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25735): Launched 07:55:55.796031 run osmo-stp_10.42.42.5(pid=25736): Launched 07:55:55.923604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:55:56.494580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25738): Launched 07:55:56.621366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:55:56.900791 run patchelf(pid=25739): Launched 07:55:57.087051 run osmo-stp_10.42.42.5(pid=25736): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25736)] 07:55:57.227582 run osmo-stp_10.42.42.5(pid=25736): stdout: | (launched: 2022-12-14_07:55:55.735179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:57.368235 run osmo-stp_10.42.42.5(pid=25736): stderr: | 20221214075555929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075555929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075555929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075555930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075555930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075555930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075555930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:57.509069 run osmo-stp_10.42.42.5(pid=25736): stdout: | (launched: 2022-12-14_07:55:55.735179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:57.643877 run osmo-stp_10.42.42.5(pid=25736): stderr: | 20221214075555929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075555929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075555929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075555930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075555930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075555930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075555930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:57.803868 run patchelf(pid=25739): Terminating (SIGINT) 07:55:57.990534 run patchelf(pid=25739): Terminated: ok {rc=0} 07:55:58.125253 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25736): Process ended prematurely: osmo-stp_10.42.42.5(pid=25736) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25736)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:55:58.135735 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:55:58.165137 run osmo-hlr_10.42.42.2(pid=25733): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25733)] 07:55:58.216541 run osmo-hlr_10.42.42.2(pid=25733): stdout: | (launched: 2022-12-14_07:55:54.704553) 07:55:58.268904 run osmo-hlr_10.42.42.2(pid=25733): stderr: | 20221214075554905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075554905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075554905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075554905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075554905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075554905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075554918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075554926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075554927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075554927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:58.321893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25724): Terminating (SIGTERM) 07:55:58.364059 run iperf3-srv_10.42.42.10(pid=25725): Terminating (SIGTERM) 07:55:58.406167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25726): Terminating (SIGTERM) 07:55:58.448550 run iperf3-srv_10.42.42.10(pid=25728): Terminating (SIGTERM) 07:55:58.490964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25732): Terminating (SIGTERM) 07:55:58.533527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25735): Terminating (SIGTERM) 07:55:58.575514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25738): Terminating (SIGTERM) 07:55:58.618269 --- ParallelTerminationStrategy: PID 25724 died... 07:55:58.638787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25724): Terminated: ok {rc=0} 07:55:58.685483 --- ParallelTerminationStrategy: PID 25725 died... 07:55:58.705383 run iperf3-srv_10.42.42.10(pid=25725): Terminated {rc=256} 07:55:58.751761 --- ParallelTerminationStrategy: PID 25726 died... 07:55:58.771580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25726): Terminated: ok {rc=0} 07:55:58.817874 --- ParallelTerminationStrategy: PID 25728 died... 07:55:58.837758 run iperf3-srv_10.42.42.10(pid=25728): Terminated {rc=256} 07:55:58.884287 --- ParallelTerminationStrategy: PID 25732 died... 07:55:58.904345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25732): Terminated: ok {rc=0} 07:55:58.950905 --- ParallelTerminationStrategy: PID 25735 died... 07:55:58.970786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25735): Terminated: ok {rc=0} 07:55:59.017349 --- ParallelTerminationStrategy: PID 25738 died... 07:55:59.037361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25738): Terminated: ok {rc=0} 07:55:59.125696 bus /gobi_0: Setting Powered False 07:56:00.225919 bus /gobi_0: Setting Powered False 07:56:01.344310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:56:02.496305 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:02.508690 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:56:02.579944 tst iperf3.py: using LAC 39495 07:56:02.709396 tst iperf3.py: using RAC 225 07:56:02.842465 tst iperf3.py: using CellId 39495 07:56:02.970806 tst iperf3.py: using BVCI 39496 07:56:03.090917 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:03.102609 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:03.114159 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:03.125609 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:03.137601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:03.149657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:03.161554 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:03.173098 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:03.184865 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:56:03.303235 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:56:03.510310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:56:03.820377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25740): Launched 07:56:04.090082 run iperf3-srv_10.42.42.10(pid=25741): Launched 07:56:04.208841 tst iperf3.py:8: start network... 07:56:04.416639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:04.896301 run create_hlr_db(pid=25742): Launched 07:56:05.023434 bus /gobi_6: Setting Powered False 07:56:06.083631 run create_hlr_db(pid=25742): Terminated: ok {rc=0} 07:56:06.533734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25744): Launched 07:56:06.867018 run osmo-hlr_10.42.42.2(pid=25745): Launched 07:56:06.994472 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:07.571407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25747): Launched 07:56:07.901094 run osmo-stp_10.42.42.5(pid=25748): Launched 07:56:08.026805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:56:08.594025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25750): Launched 07:56:08.721233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:56:09.000464 run patchelf(pid=25751): Launched 07:56:09.185808 run osmo-stp_10.42.42.5(pid=25748): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25748)] 07:56:09.324377 run osmo-stp_10.42.42.5(pid=25748): stdout: | (launched: 2022-12-14_07:56:07.840455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:09.464674 run osmo-stp_10.42.42.5(pid=25748): stderr: | 20221214075608034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075608035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075608035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075608035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075608036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075608036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075608036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:09.605128 run osmo-stp_10.42.42.5(pid=25748): stdout: | (launched: 2022-12-14_07:56:07.840455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:09.739312 run osmo-stp_10.42.42.5(pid=25748): stderr: | 20221214075608034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075608035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075608035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075608035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075608036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075608036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075608036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:09.898335 run patchelf(pid=25751): Terminating (SIGINT) 07:56:10.083596 run patchelf(pid=25751): Terminated: ok {rc=0} 07:56:10.218407 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25748): Process ended prematurely: osmo-stp_10.42.42.5(pid=25748) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25748)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 07:56:10.228722 tst iperf3.py:8: Test FAILED (7.8 sec) 07:56:10.257585 run osmo-hlr_10.42.42.2(pid=25745): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25745)] 07:56:10.308037 run osmo-hlr_10.42.42.2(pid=25745): stdout: | (launched: 2022-12-14_07:56:06.805828) 07:56:10.360309 run osmo-hlr_10.42.42.2(pid=25745): stderr: | 20221214075607006 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075607006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075607006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075607006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075607006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075607006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075607019 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075607029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075607030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075607030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:10.412942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25740): Terminating (SIGTERM) 07:56:10.455088 run iperf3-srv_10.42.42.10(pid=25741): Terminating (SIGTERM) 07:56:10.496749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25744): Terminating (SIGTERM) 07:56:10.538732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25747): Terminating (SIGTERM) 07:56:10.580766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25750): Terminating (SIGTERM) 07:56:10.623024 --- ParallelTerminationStrategy: PID 25740 died... 07:56:10.643287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25740): Terminated: ok {rc=0} 07:56:10.689514 --- ParallelTerminationStrategy: PID 25741 died... 07:56:10.709135 run iperf3-srv_10.42.42.10(pid=25741): Terminated {rc=256} 07:56:10.755402 --- ParallelTerminationStrategy: PID 25744 died... 07:56:10.775242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25744): Terminated: ok {rc=0} 07:56:10.821306 --- ParallelTerminationStrategy: PID 25747 died... 07:56:10.840999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25747): Terminated: ok {rc=0} 07:56:10.887180 --- ParallelTerminationStrategy: PID 25750 died... 07:56:10.906855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25750): Terminated: ok {rc=0} 07:56:10.994176 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:56:12.142086 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:12.154002 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:56:12.219719 tst iperf3m4.py: using LAC 39496 07:56:12.339456 tst iperf3m4.py: using RAC 226 07:56:12.461527 tst iperf3m4.py: using CellId 39496 07:56:12.583092 tst iperf3m4.py: using BVCI 39497 07:56:12.704413 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:12.716393 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:12.727870 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:12.739395 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:12.751805 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:12.763997 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:12.776478 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:12.789134 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:12.801990 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:56:12.923893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:56:13.048319 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:56:13.167975 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:56:13.291050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:56:13.512690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:56:13.844752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25752): Launched 07:56:14.134561 run iperf3-srv_10.42.42.10(pid=25753): Launched 07:56:14.259760 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:56:14.482266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:56:14.814380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25754): Launched 07:56:15.103870 run iperf3-srv_10.42.42.10(pid=25755): Launched 07:56:15.231624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:56:15.453920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:56:15.786201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25756): Launched 07:56:16.085761 run iperf3-srv_10.42.42.10(pid=25757): Launched 07:56:16.243168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:56:16.457509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:56:16.801760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25758): Launched 07:56:17.082111 run iperf3-srv_10.42.42.10(pid=25759): Launched 07:56:17.216376 tst iperf3m4.py:8: start network... 07:56:17.424193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:17.902759 run create_hlr_db(pid=25760): Launched 07:56:18.031184 bus /gobi_6: Setting Powered False 07:56:19.092123 run create_hlr_db(pid=25760): Terminated: ok {rc=0} 07:56:19.542353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25762): Launched 07:56:19.873390 run osmo-hlr_10.42.42.2(pid=25763): Launched 07:56:20.000291 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:20.570904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25765): Launched 07:56:20.901648 run osmo-stp_10.42.42.5(pid=25766): Launched 07:56:21.029587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:56:21.601209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25768): Launched 07:56:21.727585 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:56:22.007241 run patchelf(pid=25769): Launched 07:56:22.191171 run osmo-stp_10.42.42.5(pid=25766): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25766)] 07:56:22.330624 run osmo-stp_10.42.42.5(pid=25766): stdout: | (launched: 2022-12-14_07:56:20.840139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:22.471519 run osmo-stp_10.42.42.5(pid=25766): stderr: | 20221214075621037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075621037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075621037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075621038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075621038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075621038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075621038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:22.612705 run osmo-stp_10.42.42.5(pid=25766): stdout: | (launched: 2022-12-14_07:56:20.840139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:22.747116 run osmo-stp_10.42.42.5(pid=25766): stderr: | 20221214075621037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075621037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075621037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075621038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075621038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075621038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075621038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:22.906367 run patchelf(pid=25769): Terminating (SIGINT) 07:56:23.091560 run patchelf(pid=25769): Terminated: ok {rc=0} 07:56:23.226052 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25766): Process ended prematurely: osmo-stp_10.42.42.5(pid=25766) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25766)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:56:23.236419 tst iperf3m4.py:8: Test FAILED (11.1 sec) 07:56:23.265316 run osmo-hlr_10.42.42.2(pid=25763): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25763)] 07:56:23.316016 run osmo-hlr_10.42.42.2(pid=25763): stdout: | (launched: 2022-12-14_07:56:19.812328) 07:56:23.368526 run osmo-hlr_10.42.42.2(pid=25763): stderr: | 20221214075620013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075620013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075620013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075620013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075620013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075620013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075620026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075620034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075620034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075620034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:23.421189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25752): Terminating (SIGTERM) 07:56:23.463349 run iperf3-srv_10.42.42.10(pid=25753): Terminating (SIGTERM) 07:56:23.505696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25754): Terminating (SIGTERM) 07:56:23.548003 run iperf3-srv_10.42.42.10(pid=25755): Terminating (SIGTERM) 07:56:23.590063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25756): Terminating (SIGTERM) 07:56:23.632177 run iperf3-srv_10.42.42.10(pid=25757): Terminating (SIGTERM) 07:56:23.673974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25758): Terminating (SIGTERM) 07:56:23.716027 run iperf3-srv_10.42.42.10(pid=25759): Terminating (SIGTERM) 07:56:23.758215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25762): Terminating (SIGTERM) 07:56:23.800451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25765): Terminating (SIGTERM) 07:56:23.842633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25768): Terminating (SIGTERM) 07:56:23.885040 --- ParallelTerminationStrategy: PID 25752 died... 07:56:23.905492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25752): Terminated: ok {rc=0} 07:56:23.951898 --- ParallelTerminationStrategy: PID 25753 died... 07:56:23.971697 run iperf3-srv_10.42.42.10(pid=25753): Terminated {rc=256} 07:56:24.017925 --- ParallelTerminationStrategy: PID 25754 died... 07:56:24.037861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25754): Terminated: ok {rc=0} 07:56:24.084157 --- ParallelTerminationStrategy: PID 25755 died... 07:56:24.104077 run iperf3-srv_10.42.42.10(pid=25755): Terminated {rc=256} 07:56:24.150278 --- ParallelTerminationStrategy: PID 25756 died... 07:56:24.170267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25756): Terminated: ok {rc=0} 07:56:24.216582 --- ParallelTerminationStrategy: PID 25757 died... 07:56:24.236531 run iperf3-srv_10.42.42.10(pid=25757): Terminated {rc=256} 07:56:24.282574 --- ParallelTerminationStrategy: PID 25758 died... 07:56:24.302508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25758): Terminated: ok {rc=0} 07:56:24.348812 --- ParallelTerminationStrategy: PID 25759 died... 07:56:24.369217 run iperf3-srv_10.42.42.10(pid=25759): Terminated {rc=256} 07:56:24.415259 --- ParallelTerminationStrategy: PID 25762 died... 07:56:24.435142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25762): Terminated: ok {rc=0} 07:56:24.480936 --- ParallelTerminationStrategy: PID 25765 died... 07:56:24.500834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25765): Terminated: ok {rc=0} 07:56:24.547293 --- ParallelTerminationStrategy: PID 25768 died... 07:56:24.567244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25768): Terminated: ok {rc=0} 07:56:24.656899 bus /gobi_4: Setting Powered False 07:56:25.755496 bus /gobi_4: Setting Powered False 07:56:26.870843 bus /gobi_1: Setting Powered False 07:56:27.969389 bus /gobi_1: Setting Powered False 07:56:29.086688 bus /gobi_0: Setting Powered False 07:56:30.184525 bus /gobi_0: Setting Powered False 07:56:31.313947 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:56:32.414898 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:32.427412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:56:32.496500 tst ping.py: using LAC 39497 07:56:32.622563 tst ping.py: using RAC 227 07:56:32.750061 tst ping.py: using CellId 39497 07:56:32.875925 tst ping.py: using BVCI 39498 07:56:32.993289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:33.005165 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:33.016664 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:33.028346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:33.040053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:33.051823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:33.063611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:33.075374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:56:33.196634 tst ping.py:19: start network... 07:56:33.414887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:33.914751 run create_hlr_db(pid=25770): Launched 07:56:34.039275 bus /gobi_6: Setting Powered False 07:56:35.103052 run create_hlr_db(pid=25770): Terminated: ok {rc=0} 07:56:35.555282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25772): Launched 07:56:35.881462 run osmo-hlr_10.42.42.2(pid=25773): Launched 07:56:36.006684 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:36.565938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25775): Launched 07:56:36.890201 run osmo-stp_10.42.42.5(pid=25776): Launched 07:56:37.014979 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:56:37.573756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25778): Launched 07:56:37.698805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:56:37.972226 run patchelf(pid=25779): Launched 07:56:38.153863 run osmo-stp_10.42.42.5(pid=25776): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25776)] 07:56:38.291538 run osmo-stp_10.42.42.5(pid=25776): stdout: | (launched: 2022-12-14_07:56:36.830254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:38.430042 run osmo-stp_10.42.42.5(pid=25776): stderr: | 20221214075637023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075637024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075637024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075637024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075637027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075637027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075637027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:38.568681 run osmo-stp_10.42.42.5(pid=25776): stdout: | (launched: 2022-12-14_07:56:36.830254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:38.700724 run osmo-stp_10.42.42.5(pid=25776): stderr: | 20221214075637023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075637024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075637024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075637024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075637027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075637027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075637027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:38.857115 run patchelf(pid=25779): Terminating (SIGINT) 07:56:39.039412 run patchelf(pid=25779): Terminated: ok {rc=0} 07:56:39.171030 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25776): Process ended prematurely: osmo-stp_10.42.42.5(pid=25776) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25776)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 07:56:39.180750 tst ping.py:22: Test FAILED (6.8 sec) 07:56:39.209184 run osmo-hlr_10.42.42.2(pid=25773): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25773)] 07:56:39.260139 run osmo-hlr_10.42.42.2(pid=25773): stdout: | (launched: 2022-12-14_07:56:35.821388) 07:56:39.312517 run osmo-hlr_10.42.42.2(pid=25773): stderr: | 20221214075636023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075636023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075636023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075636023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075636023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075636023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075636066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075636076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075636077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075636077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:39.365574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25772): Terminating (SIGTERM) 07:56:39.407646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25775): Terminating (SIGTERM) 07:56:39.450106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25778): Terminating (SIGTERM) 07:56:39.492936 --- ParallelTerminationStrategy: PID 25772 died... 07:56:39.513720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25772): Terminated: ok {rc=0} 07:56:39.560440 --- ParallelTerminationStrategy: PID 25775 died... 07:56:39.580565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25775): Terminated: ok {rc=0} 07:56:39.626940 --- ParallelTerminationStrategy: PID 25778 died... 07:56:39.647048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25778): Terminated: ok {rc=0} 07:56:39.735436 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:56:40.824477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:40.836858 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:56:40.906676 tst ping_idle_ping.py: using LAC 39498 07:56:41.037504 tst ping_idle_ping.py: using RAC 228 07:56:41.165315 tst ping_idle_ping.py: using CellId 39498 07:56:41.293375 tst ping_idle_ping.py: using BVCI 39499 07:56:41.412724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:41.424762 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:41.436517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:41.448141 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:41.460211 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:41.472295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:41.484247 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:56:41.496278 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:56:41.615223 tst ping_idle_ping.py:24: start network... 07:56:41.818339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:42.290200 run create_hlr_db(pid=25780): Launched 07:56:42.415975 bus /gobi_6: Setting Powered False 07:56:43.476736 run create_hlr_db(pid=25780): Terminated: ok {rc=0} 07:56:43.921171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25782): Launched 07:56:44.248478 run osmo-hlr_10.42.42.2(pid=25783): Launched 07:56:44.374083 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:44.936393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25785): Launched 07:56:45.263109 run osmo-stp_10.42.42.5(pid=25786): Launched 07:56:45.387143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:56:45.965770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25788): Launched 07:56:46.105220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:56:46.369747 run patchelf(pid=25789): Launched 07:56:46.565270 run osmo-stp_10.42.42.5(pid=25786): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25786)] 07:56:46.706623 run osmo-stp_10.42.42.5(pid=25786): stdout: | (launched: 2022-12-14_07:56:45.202366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:46.849842 run osmo-stp_10.42.42.5(pid=25786): stderr: | 20221214075645396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075645396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075645396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075645397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075645397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075645397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075645398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:46.992856 run osmo-stp_10.42.42.5(pid=25786): stdout: | (launched: 2022-12-14_07:56:45.202366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:47.129253 run osmo-stp_10.42.42.5(pid=25786): stderr: | 20221214075645396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075645396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075645396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075645397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075645397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075645397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075645398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:47.289965 run patchelf(pid=25789): Terminating (SIGINT) 07:56:47.473595 run patchelf(pid=25789): Terminated: ok {rc=0} 07:56:47.606073 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25786): Process ended prematurely: osmo-stp_10.42.42.5(pid=25786) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25786)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:56:47.616013 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:56:47.644669 run osmo-hlr_10.42.42.2(pid=25783): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25783)] 07:56:47.696351 run osmo-hlr_10.42.42.2(pid=25783): stdout: | (launched: 2022-12-14_07:56:44.188443) 07:56:47.748883 run osmo-hlr_10.42.42.2(pid=25783): stderr: | 20221214075644389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075644389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075644389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075644389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075644389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075644389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075644402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075644410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075644410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075644410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:47.801978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25782): Terminating (SIGTERM) 07:56:47.843853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25785): Terminating (SIGTERM) 07:56:47.886274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25788): Terminating (SIGTERM) 07:56:47.929074 --- ParallelTerminationStrategy: PID 25782 died... 07:56:47.949697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25782): Terminated: ok {rc=0} 07:56:47.996619 --- ParallelTerminationStrategy: PID 25785 died... 07:56:48.016861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25785): Terminated: ok {rc=0} 07:56:48.063585 --- ParallelTerminationStrategy: PID 25788 died... 07:56:48.083998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25788): Terminated: ok {rc=0} 07:56:48.174008 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:56:49.481659 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:56:49.488195 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:56:49.516886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:56:49.555277 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:56:49.642231 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:56:49.671374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:56:49.709376 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:56:50.306691 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:56:50.356246 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:56:50.367559 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:56:50.434256 tst cs_paging_gprs_active.py: using LAC 39499 07:56:50.557053 tst cs_paging_gprs_active.py: using RAC 229 07:56:50.681854 tst cs_paging_gprs_active.py: using CellId 39499 07:56:50.802596 tst cs_paging_gprs_active.py: using BVCI 39500 07:56:50.915563 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:56:50.926988 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:56:50.937997 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:56:50.948919 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:56:50.959959 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:56:50.970980 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:56:50.982052 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:56:50.992834 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:56:51.003922 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:56:51.125704 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:56:51.243307 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:56:51.450034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:56:51.760269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25793): Launched 07:56:52.030356 run iperf3-srv_10.42.42.10(pid=25794): Launched 07:56:52.146257 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:56:52.351848 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:56:52.661794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25795): Launched 07:56:52.935454 run iperf3-srv_10.42.42.10(pid=25796): Launched 07:56:53.051297 tst cs_paging_gprs_active.py:38: start network... 07:56:53.257642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:53.735728 run create_hlr_db(pid=25797): Launched 07:56:53.862839 bus /gobi_6: Setting Powered False 07:56:54.925082 run create_hlr_db(pid=25797): Terminated: ok {rc=0} 07:56:55.355337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25799): Launched 07:56:55.666822 run osmo-hlr_10.42.42.2(pid=25800): Launched 07:56:55.786326 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:56.326714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25802): Launched 07:56:56.636737 run osmo-stp_10.42.42.5(pid=25803): Launched 07:56:56.755658 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:56:57.287453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25805): Launched 07:56:57.406925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:56:57.675464 run patchelf(pid=25806): Launched 07:56:57.848191 run osmo-stp_10.42.42.5(pid=25803): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25803)] 07:56:57.979143 run osmo-stp_10.42.42.5(pid=25803): stdout: | (launched: 2022-12-14_07:56:56.579197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:58.111523 run osmo-stp_10.42.42.5(pid=25803): stderr: | 20221214075656749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075656750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075656750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075656750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075656751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075656751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075656751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:58.243443 run osmo-stp_10.42.42.5(pid=25803): stdout: | (launched: 2022-12-14_07:56:56.579197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:58.369524 run osmo-stp_10.42.42.5(pid=25803): stderr: | 20221214075656749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075656750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075656750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075656750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075656751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075656751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075656751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:58.518909 run patchelf(pid=25806): Terminating (SIGINT) 07:56:58.693924 run patchelf(pid=25806): Terminated: ok {rc=0} 07:56:58.820686 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25803): Process ended prematurely: osmo-stp_10.42.42.5(pid=25803) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25803)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:56:58.830505 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 07:56:58.857930 run osmo-hlr_10.42.42.2(pid=25800): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25800)] 07:56:58.905551 run osmo-hlr_10.42.42.2(pid=25800): stdout: | (launched: 2022-12-14_07:56:55.609264) 07:56:58.955030 run osmo-hlr_10.42.42.2(pid=25800): stderr: | 20221214075655787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075655787 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075655787 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075655787 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075655787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075655787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075655799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075655807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075655807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075655808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:59.004865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25793): Terminating (SIGTERM) 07:56:59.044641 run iperf3-srv_10.42.42.10(pid=25794): Terminating (SIGTERM) 07:56:59.084431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25795): Terminating (SIGTERM) 07:56:59.124312 run iperf3-srv_10.42.42.10(pid=25796): Terminating (SIGTERM) 07:56:59.163880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25799): Terminating (SIGTERM) 07:56:59.203771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25802): Terminating (SIGTERM) 07:56:59.243633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25805): Terminating (SIGTERM) 07:56:59.283514 --- ParallelTerminationStrategy: PID 25793 died... 07:56:59.302839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25793): Terminated: ok {rc=0} 07:56:59.346942 --- ParallelTerminationStrategy: PID 25794 died... 07:56:59.365625 run iperf3-srv_10.42.42.10(pid=25794): Terminated {rc=256} 07:56:59.409240 --- ParallelTerminationStrategy: PID 25795 died... 07:56:59.427741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25795): Terminated: ok {rc=0} 07:56:59.471665 --- ParallelTerminationStrategy: PID 25796 died... 07:56:59.490326 run iperf3-srv_10.42.42.10(pid=25796): Terminated {rc=256} 07:56:59.533995 --- ParallelTerminationStrategy: PID 25799 died... 07:56:59.552802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25799): Terminated: ok {rc=0} 07:56:59.596640 --- ParallelTerminationStrategy: PID 25802 died... 07:56:59.615390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25802): Terminated: ok {rc=0} 07:56:59.658890 --- ParallelTerminationStrategy: PID 25805 died... 07:56:59.677671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25805): Terminated: ok {rc=0} 07:56:59.763913 bus /gobi_0: Setting Powered False 07:57:00.880200 bus /gobi_0: Setting Powered False 07:57:02.010071 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:57:03.158946 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:03.170903 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:57:03.245224 tst iperf3.py: using LAC 39500 07:57:03.378959 tst iperf3.py: using RAC 230 07:57:03.500806 tst iperf3.py: using CellId 39500 07:57:03.619570 tst iperf3.py: using BVCI 39501 07:57:03.741957 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:03.753700 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:03.764924 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:03.776442 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:03.789530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:03.801764 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:03.814051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:03.826047 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:03.838401 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:57:03.962147 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:57:04.185337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:04.516491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25807): Launched 07:57:04.806892 run iperf3-srv_10.42.42.10(pid=25808): Launched 07:57:04.930864 tst iperf3.py:8: start network... 07:57:05.152824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:05.664673 run create_hlr_db(pid=25809): Launched 07:57:05.791695 bus /gobi_6: Setting Powered False 07:57:06.855926 run create_hlr_db(pid=25809): Terminated: ok {rc=0} 07:57:07.298335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25811): Launched 07:57:07.608511 run osmo-hlr_10.42.42.2(pid=25812): Launched 07:57:07.725804 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:08.257556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25814): Launched 07:57:08.570510 run osmo-stp_10.42.42.5(pid=25815): Launched 07:57:08.688245 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:57:09.220831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25817): Launched 07:57:09.339173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:57:09.600445 run patchelf(pid=25818): Launched 07:57:09.772744 run osmo-stp_10.42.42.5(pid=25815): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25815)] 07:57:09.903047 run osmo-stp_10.42.42.5(pid=25815): stdout: | (launched: 2022-12-14_07:57:08.512639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:10.035351 run osmo-stp_10.42.42.5(pid=25815): stderr: | 20221214075708686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075708686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075708686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075708687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075708687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075708687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075708687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:10.169799 run osmo-stp_10.42.42.5(pid=25815): stdout: | (launched: 2022-12-14_07:57:08.512639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:10.296464 run osmo-stp_10.42.42.5(pid=25815): stderr: | 20221214075708686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075708686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075708686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075708687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075708687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075708687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075708687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:10.446324 run patchelf(pid=25818): Terminating (SIGINT) 07:57:10.620812 run patchelf(pid=25818): Terminated: ok {rc=0} 07:57:10.746566 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25815): Process ended prematurely: osmo-stp_10.42.42.5(pid=25815) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25815)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 07:57:10.756361 tst iperf3.py:8: Test FAILED (7.6 sec) 07:57:10.783753 run osmo-hlr_10.42.42.2(pid=25812): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25812)] 07:57:10.831091 run osmo-hlr_10.42.42.2(pid=25812): stdout: | (launched: 2022-12-14_07:57:07.550881) 07:57:10.880340 run osmo-hlr_10.42.42.2(pid=25812): stderr: | 20221214075707729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075707729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075707729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075707729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075707729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075707729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075707742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075707750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075707750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075707750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:10.930447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25807): Terminating (SIGTERM) 07:57:10.970202 run iperf3-srv_10.42.42.10(pid=25808): Terminating (SIGTERM) 07:57:11.010334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25811): Terminating (SIGTERM) 07:57:11.050319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25814): Terminating (SIGTERM) 07:57:11.090029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25817): Terminating (SIGTERM) 07:57:11.130085 --- ParallelTerminationStrategy: PID 25807 died... 07:57:11.149486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25807): Terminated: ok {rc=0} 07:57:11.193316 --- ParallelTerminationStrategy: PID 25808 died... 07:57:11.211945 run iperf3-srv_10.42.42.10(pid=25808): Terminated {rc=256} 07:57:11.255677 --- ParallelTerminationStrategy: PID 25811 died... 07:57:11.274375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25811): Terminated: ok {rc=0} 07:57:11.318073 --- ParallelTerminationStrategy: PID 25814 died... 07:57:11.336726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25814): Terminated: ok {rc=0} 07:57:11.380353 --- ParallelTerminationStrategy: PID 25817 died... 07:57:11.399133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25817): Terminated: ok {rc=0} 07:57:11.482627 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:57:12.634244 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:12.646584 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:57:12.716573 tst iperf3m4.py: using LAC 39501 07:57:12.847140 tst iperf3m4.py: using RAC 231 07:57:12.977256 tst iperf3m4.py: using CellId 39501 07:57:13.109237 tst iperf3m4.py: using BVCI 39502 07:57:13.230235 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:13.241981 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:13.253471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:13.265025 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:13.276903 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:13.289028 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:13.301412 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:13.313083 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:13.325142 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:57:13.448877 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:57:13.569496 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:57:13.689771 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:57:13.807752 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:57:14.013815 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:14.335586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25819): Launched 07:57:14.625311 run iperf3-srv_10.42.42.10(pid=25820): Launched 07:57:14.750802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:57:14.972921 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:15.299360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25821): Launched 07:57:15.569453 run iperf3-srv_10.42.42.10(pid=25822): Launched 07:57:15.686174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:57:15.894347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:16.212935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25823): Launched 07:57:16.509504 run iperf3-srv_10.42.42.10(pid=25824): Launched 07:57:16.687056 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:57:16.954590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:17.273753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25825): Launched 07:57:17.555195 run iperf3-srv_10.42.42.10(pid=25826): Launched 07:57:17.673213 tst iperf3m4.py:8: start network... 07:57:17.878480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:18.356098 run create_hlr_db(pid=25827): Launched 07:57:18.484670 bus /gobi_6: Setting Powered False 07:57:19.545863 run create_hlr_db(pid=25827): Terminated: ok {rc=0} 07:57:19.976488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25829): Launched 07:57:20.314109 run osmo-hlr_10.42.42.2(pid=25830): Launched 07:57:20.442331 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:21.017241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25832): Launched 07:57:21.351262 run osmo-stp_10.42.42.5(pid=25833): Launched 07:57:21.478312 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:57:22.049140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25835): Launched 07:57:22.177552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:57:22.457680 run patchelf(pid=25836): Launched 07:57:22.644533 run osmo-stp_10.42.42.5(pid=25833): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25833)] 07:57:22.784544 run osmo-stp_10.42.42.5(pid=25833): stdout: | (launched: 2022-12-14_07:57:21.289984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:22.926843 run osmo-stp_10.42.42.5(pid=25833): stderr: | 20221214075721484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075721484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075721484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075721485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075721485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075721485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075721485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:23.068920 run osmo-stp_10.42.42.5(pid=25833): stdout: | (launched: 2022-12-14_07:57:21.289984) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:23.205025 run osmo-stp_10.42.42.5(pid=25833): stderr: | 20221214075721484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075721484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075721484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075721485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075721485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075721485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075721485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:23.365907 run patchelf(pid=25836): Terminating (SIGINT) 07:57:23.553097 run patchelf(pid=25836): Terminated: ok {rc=0} 07:57:23.688227 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25833): Process ended prematurely: osmo-stp_10.42.42.5(pid=25833) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25833)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:57:23.698695 tst iperf3m4.py:8: Test FAILED (11.1 sec) 07:57:23.727611 run osmo-hlr_10.42.42.2(pid=25830): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25830)] 07:57:23.778359 run osmo-hlr_10.42.42.2(pid=25830): stdout: | (launched: 2022-12-14_07:57:20.252647) 07:57:23.830863 run osmo-hlr_10.42.42.2(pid=25830): stderr: | 20221214075720453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075720453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075720453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075720453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075720454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075720454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075720465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075720474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075720474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075720474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:23.883515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25819): Terminating (SIGTERM) 07:57:23.925515 run iperf3-srv_10.42.42.10(pid=25820): Terminating (SIGTERM) 07:57:23.967719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25821): Terminating (SIGTERM) 07:57:24.009867 run iperf3-srv_10.42.42.10(pid=25822): Terminating (SIGTERM) 07:57:24.051796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25823): Terminating (SIGTERM) 07:57:24.094118 run iperf3-srv_10.42.42.10(pid=25824): Terminating (SIGTERM) 07:57:24.136035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25825): Terminating (SIGTERM) 07:57:24.178213 run iperf3-srv_10.42.42.10(pid=25826): Terminating (SIGTERM) 07:57:24.220420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25829): Terminating (SIGTERM) 07:57:24.262638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25832): Terminating (SIGTERM) 07:57:24.304805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25835): Terminating (SIGTERM) 07:57:24.347342 --- ParallelTerminationStrategy: PID 25819 died... 07:57:24.367980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25819): Terminated: ok {rc=0} 07:57:24.415190 --- ParallelTerminationStrategy: PID 25820 died... 07:57:24.435047 run iperf3-srv_10.42.42.10(pid=25820): Terminated {rc=256} 07:57:24.481298 --- ParallelTerminationStrategy: PID 25821 died... 07:57:24.501233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25821): Terminated: ok {rc=0} 07:57:24.547459 --- ParallelTerminationStrategy: PID 25822 died... 07:57:24.567288 run iperf3-srv_10.42.42.10(pid=25822): Terminated {rc=256} 07:57:24.613663 --- ParallelTerminationStrategy: PID 25823 died... 07:57:24.633508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25823): Terminated: ok {rc=0} 07:57:24.679738 --- ParallelTerminationStrategy: PID 25824 died... 07:57:24.699678 run iperf3-srv_10.42.42.10(pid=25824): Terminated {rc=256} 07:57:24.745948 --- ParallelTerminationStrategy: PID 25825 died... 07:57:24.765885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25825): Terminated: ok {rc=0} 07:57:24.812364 --- ParallelTerminationStrategy: PID 25826 died... 07:57:24.832206 run iperf3-srv_10.42.42.10(pid=25826): Terminated {rc=256} 07:57:24.878376 --- ParallelTerminationStrategy: PID 25829 died... 07:57:24.898191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25829): Terminated: ok {rc=0} 07:57:24.944489 --- ParallelTerminationStrategy: PID 25832 died... 07:57:24.964319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25832): Terminated: ok {rc=0} 07:57:25.010576 --- ParallelTerminationStrategy: PID 25835 died... 07:57:25.030489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25835): Terminated: ok {rc=0} 07:57:25.119991 bus /gobi_4: Setting Powered False 07:57:26.220000 bus /gobi_4: Setting Powered False 07:57:27.337468 bus /gobi_1: Setting Powered False 07:57:28.436807 bus /gobi_1: Setting Powered False 07:57:29.553397 bus /gobi_0: Setting Powered False 07:57:30.651711 bus /gobi_0: Setting Powered False 07:57:31.776397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:57:32.880357 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:32.892757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:57:32.962746 tst ping.py: using LAC 39502 07:57:33.090654 tst ping.py: using RAC 232 07:57:33.217831 tst ping.py: using CellId 39502 07:57:33.344745 tst ping.py: using BVCI 39503 07:57:33.462797 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:33.474544 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:33.485984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:33.497491 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:33.509233 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:33.520864 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:33.532896 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:33.544747 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:57:33.666553 tst ping.py:19: start network... 07:57:33.884265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:34.384748 run create_hlr_db(pid=25837): Launched 07:57:34.508110 bus /gobi_6: Setting Powered False 07:57:35.572864 run create_hlr_db(pid=25837): Terminated: ok {rc=0} 07:57:36.006869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25839): Launched 07:57:36.311786 run osmo-hlr_10.42.42.2(pid=25840): Launched 07:57:36.427684 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:36.951489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25842): Launched 07:57:37.257278 run osmo-stp_10.42.42.5(pid=25843): Launched 07:57:37.372810 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:57:37.893406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25845): Launched 07:57:38.010507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:57:38.265688 run patchelf(pid=25846): Launched 07:57:38.436565 run osmo-stp_10.42.42.5(pid=25843): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25843)] 07:57:38.564829 run osmo-stp_10.42.42.5(pid=25843): stdout: | (launched: 2022-12-14_07:57:37.200539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:38.695003 run osmo-stp_10.42.42.5(pid=25843): stderr: | 20221214075737372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075737373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075737373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075737373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075737374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075737374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075737374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:38.825317 run osmo-stp_10.42.42.5(pid=25843): stdout: | (launched: 2022-12-14_07:57:37.200539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:38.948835 run osmo-stp_10.42.42.5(pid=25843): stderr: | 20221214075737372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075737373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075737373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075737373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075737374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075737374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075737374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:39.096303 run patchelf(pid=25846): Terminating (SIGINT) 07:57:39.269148 run patchelf(pid=25846): Terminated: ok {rc=0} 07:57:39.392574 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25843): Process ended prematurely: osmo-stp_10.42.42.5(pid=25843) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25843)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 07:57:39.401554 tst ping.py:22: Test FAILED (6.5 sec) 07:57:39.428425 run osmo-hlr_10.42.42.2(pid=25840): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25840)] 07:57:39.476032 run osmo-hlr_10.42.42.2(pid=25840): stdout: | (launched: 2022-12-14_07:57:36.255352) 07:57:39.525455 run osmo-hlr_10.42.42.2(pid=25840): stderr: | 20221214075736430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075736430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075736430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075736430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075736430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075736430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075736443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075736452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075736452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075736452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:39.575272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25839): Terminating (SIGTERM) 07:57:39.615406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25842): Terminating (SIGTERM) 07:57:39.655303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25845): Terminating (SIGTERM) 07:57:39.695348 --- ParallelTerminationStrategy: PID 25839 died... 07:57:39.714809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25839): Terminated: ok {rc=0} 07:57:39.758978 --- ParallelTerminationStrategy: PID 25842 died... 07:57:39.777793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25842): Terminated: ok {rc=0} 07:57:39.821670 --- ParallelTerminationStrategy: PID 25845 died... 07:57:39.840366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25845): Terminated: ok {rc=0} 07:57:39.925761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:57:41.013954 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:41.026732 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:57:41.097933 tst ping_idle_ping.py: using LAC 39503 07:57:41.222492 tst ping_idle_ping.py: using RAC 233 07:57:41.340678 tst ping_idle_ping.py: using CellId 39503 07:57:41.458728 tst ping_idle_ping.py: using BVCI 39504 07:57:41.569582 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:41.581196 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:41.592201 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:41.603217 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:41.614200 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:41.625318 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:41.636391 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:57:41.647358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:57:41.767733 tst ping_idle_ping.py:24: start network... 07:57:41.987735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:42.494683 run create_hlr_db(pid=25847): Launched 07:57:42.622297 bus /gobi_6: Setting Powered False 07:57:43.686426 run create_hlr_db(pid=25847): Terminated: ok {rc=0} 07:57:44.141346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25849): Launched 07:57:44.469191 run osmo-hlr_10.42.42.2(pid=25850): Launched 07:57:44.596055 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:45.159994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25852): Launched 07:57:45.488383 run osmo-stp_10.42.42.5(pid=25853): Launched 07:57:45.614755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:57:46.201590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25855): Launched 07:57:46.351898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:57:46.632298 run patchelf(pid=25856): Launched 07:57:46.828902 run osmo-stp_10.42.42.5(pid=25853): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25853)] 07:57:46.969859 run osmo-stp_10.42.42.5(pid=25853): stdout: | (launched: 2022-12-14_07:57:45.428078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:47.112275 run osmo-stp_10.42.42.5(pid=25853): stderr: | 20221214075745624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075745624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075745624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075745624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075745625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075745625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075745625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:47.255474 run osmo-stp_10.42.42.5(pid=25853): stdout: | (launched: 2022-12-14_07:57:45.428078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:47.389053 run osmo-stp_10.42.42.5(pid=25853): stderr: | 20221214075745624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075745624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075745624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075745624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075745625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075745625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075745625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:47.546461 run patchelf(pid=25856): Terminating (SIGINT) 07:57:47.730104 run patchelf(pid=25856): Terminated: ok {rc=0} 07:57:47.862665 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25853): Process ended prematurely: osmo-stp_10.42.42.5(pid=25853) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25853)] [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:57:47.872564 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 07:57:47.901383 run osmo-hlr_10.42.42.2(pid=25850): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25850)] 07:57:47.952714 run osmo-hlr_10.42.42.2(pid=25850): stdout: | (launched: 2022-12-14_07:57:44.408869) 07:57:48.005857 run osmo-hlr_10.42.42.2(pid=25850): stderr: | 20221214075744607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075744607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075744607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075744608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075744608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075744608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075744621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075744629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075744629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075744629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:48.058902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25849): Terminating (SIGTERM) 07:57:48.101592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25852): Terminating (SIGTERM) 07:57:48.144631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25855): Terminating (SIGTERM) 07:57:48.187727 --- ParallelTerminationStrategy: PID 25849 died... 07:57:48.208867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25849): Terminated: ok {rc=0} 07:57:48.256024 --- ParallelTerminationStrategy: PID 25852 died... 07:57:48.276229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25852): Terminated: ok {rc=0} 07:57:48.323002 --- ParallelTerminationStrategy: PID 25855 died... 07:57:48.343307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25855): Terminated: ok {rc=0} 07:57:48.433425 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:57:49.739508 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:57:49.746893 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:57:49.776603 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:57:49.813591 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:57:49.867019 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:57:49.896535 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:57:49.931108 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:57:50.489287 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:57:50.494345 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:57:50.505912 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:57:50.573365 tst switch_tch_pdch.py: using LAC 39504 07:57:50.692841 tst switch_tch_pdch.py: using RAC 234 07:57:50.812618 tst switch_tch_pdch.py: using CellId 39504 07:57:50.932926 tst switch_tch_pdch.py: using BVCI 39505 07:57:51.053483 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:57:51.065351 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:57:51.077080 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:57:51.088835 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:57:51.100924 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:57:51.113083 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:57:51.125201 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:57:51.137135 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:57:51.257277 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:57:51.379372 tst switch_tch_pdch.py:51: start network... 07:57:51.597808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:52.099769 run create_hlr_db(pid=25863): Launched 07:57:52.225496 bus /gobi_6: Setting Powered False 07:57:53.286522 run create_hlr_db(pid=25863): Terminated: ok {rc=0} 07:57:53.741791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25865): Launched 07:57:54.067453 run osmo-hlr_10.42.42.2(pid=25866): Launched 07:57:54.193453 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:54.716263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25868): Launched 07:57:55.020403 run osmo-stp_10.42.42.5(pid=25869): Launched 07:57:55.136334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:57:55.671740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25871): Launched 07:57:55.788290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:57:56.043662 run patchelf(pid=25872): Launched 07:57:56.213957 run osmo-stp_10.42.42.5(pid=25869): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25869)] 07:57:56.341224 run osmo-stp_10.42.42.5(pid=25869): stdout: | (launched: 2022-12-14_07:57:54.963707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:56.470305 run osmo-stp_10.42.42.5(pid=25869): stderr: | 20221214075755136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075755136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075755136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075755137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075755137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075755138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075755138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:56.599787 run osmo-stp_10.42.42.5(pid=25869): stdout: | (launched: 2022-12-14_07:57:54.963707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:56.722371 run osmo-stp_10.42.42.5(pid=25869): stderr: | 20221214075755136 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075755136 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075755136 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075755137 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075755137 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075755138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075755138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:56.867514 run patchelf(pid=25872): Terminating (SIGINT) 07:57:57.037279 run patchelf(pid=25872): Terminated: ok {rc=0} 07:57:57.160179 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25869): Process ended prematurely: osmo-stp_10.42.42.5(pid=25869) [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25869)] [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:57:57.169369 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:57:57.196222 run osmo-hlr_10.42.42.2(pid=25866): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25866)] 07:57:57.243463 run osmo-hlr_10.42.42.2(pid=25866): stdout: | (launched: 2022-12-14_07:57:54.007370) 07:57:57.293297 run osmo-hlr_10.42.42.2(pid=25866): stderr: | 20221214075754208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075754208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075754208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075754208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075754208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075754208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075754221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075754229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075754229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075754229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:57.343023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25865): Terminating (SIGTERM) 07:57:57.382844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25868): Terminating (SIGTERM) 07:57:57.422606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25871): Terminating (SIGTERM) 07:57:57.462580 --- ParallelTerminationStrategy: PID 25865 died... 07:57:57.481793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25865): Terminated: ok {rc=0} 07:57:57.525709 --- ParallelTerminationStrategy: PID 25868 died... 07:57:57.544477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25868): Terminated: ok {rc=0} 07:57:57.588321 --- ParallelTerminationStrategy: PID 25871 died... 07:57:57.606965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25871): Terminated: ok {rc=0} 07:57:57.691512 bus /gobi_0: Setting Powered False 07:57:58.790472 bus /gobi_0: Setting Powered False 07:57:59.907280 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:58:01.213537 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:58:01.219749 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:58:01.249490 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:58:01.285288 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:58:01.342034 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:58:01.381294 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:58:01.433558 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:58:01.994166 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:58:02.002927 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:58:02.019828 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:58:02.093404 tst switch_tch_pdch.py: using LAC 39505 07:58:02.223848 tst switch_tch_pdch.py: using RAC 235 07:58:02.344927 tst switch_tch_pdch.py: using CellId 39505 07:58:02.463102 tst switch_tch_pdch.py: using BVCI 39506 07:58:02.573510 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:58:02.584935 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:58:02.596432 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:58:02.607624 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:58:02.618729 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:58:02.629826 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:58:02.640867 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:58:02.651845 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:58:02.773477 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:58:02.895934 tst switch_tch_pdch.py:51: start network... 07:58:03.115243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:03.591061 run create_hlr_db(pid=25876): Launched 07:58:03.717687 bus /gobi_6: Setting Powered False 07:58:04.782008 run create_hlr_db(pid=25876): Terminated: ok {rc=0} 07:58:05.192520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25878): Launched 07:58:05.499364 run osmo-hlr_10.42.42.2(pid=25879): Launched 07:58:05.616229 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:06.130831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25881): Launched 07:58:06.436505 run osmo-stp_10.42.42.5(pid=25882): Launched 07:58:06.551693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:58:07.049088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25884): Launched 07:58:07.165281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:58:07.422060 run patchelf(pid=25885): Launched 07:58:07.591747 run osmo-stp_10.42.42.5(pid=25882): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25882)] 07:58:07.720264 run osmo-stp_10.42.42.5(pid=25882): stdout: | (launched: 2022-12-14_07:58:06.379723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:07.849912 run osmo-stp_10.42.42.5(pid=25882): stderr: | 20221214075806552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075806552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075806552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075806553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075806553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075806553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075806553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:07.979435 run osmo-stp_10.42.42.5(pid=25882): stdout: | (launched: 2022-12-14_07:58:06.379723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:08.102678 run osmo-stp_10.42.42.5(pid=25882): stderr: | 20221214075806552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075806552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075806552 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075806553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075806553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075806553 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075806553 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:08.248764 run patchelf(pid=25885): Terminating (SIGINT) 07:58:08.419924 run patchelf(pid=25885): Terminated: ok {rc=0} 07:58:08.543359 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25882): Process ended prematurely: osmo-stp_10.42.42.5(pid=25882) [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25882)] [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:58:08.552280 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 07:58:08.579309 run osmo-hlr_10.42.42.2(pid=25879): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25879)] 07:58:08.626790 run osmo-hlr_10.42.42.2(pid=25879): stdout: | (launched: 2022-12-14_07:58:05.441952) 07:58:08.676237 run osmo-hlr_10.42.42.2(pid=25879): stderr: | 20221214075805621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075805621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075805621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075805621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075805621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075805621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075805634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075805644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075805645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075805645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:08.726157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25878): Terminating (SIGTERM) 07:58:08.766210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25881): Terminating (SIGTERM) 07:58:08.806325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25884): Terminating (SIGTERM) 07:58:08.846544 --- ParallelTerminationStrategy: PID 25878 died... 07:58:08.865880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25878): Terminated: ok {rc=0} 07:58:08.910199 --- ParallelTerminationStrategy: PID 25881 died... 07:58:08.928885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25881): Terminated: ok {rc=0} 07:58:08.973138 --- ParallelTerminationStrategy: PID 25884 died... 07:58:08.991721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25884): Terminated: ok {rc=0} 07:58:09.078225 bus /gobi_0: Setting Powered False 07:58:10.178383 bus /gobi_0: Setting Powered False 07:58:11.296402 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_sms:nanobts --------------------------------------------------------------------- 07:58:12.544509 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:58:12.548145 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 07:58:12.571559 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 07:58:12.578297 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 07:58:12.631063 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 07:58:12.655203 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 07:58:12.661912 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 07:58:13.197415 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 07:58:13.202400 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 07:58:13.213196 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 07:58:13.251264 tst mo_mt_sms.py: using LAC 39506 07:58:13.370365 tst mo_mt_sms.py: using RAC 236 07:58:13.492310 tst mo_mt_sms.py: using CellId 39506 07:58:13.612542 tst mo_mt_sms.py: using BVCI 39507 07:58:13.724106 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 07:58:13.845073 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 07:58:13.962366 tst mo_mt_sms.py:9: start nitb and bts... 07:58:14.165583 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:58:14.784368 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25890): Launched 07:58:15.087586 run osmo-nitb_10.42.42.2(pid=25891): Launched 07:58:15.255306 run osmo-nitb_10.42.42.2(pid=25891): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25891)] 07:58:15.390739 run osmo-nitb_10.42.42.2(pid=25891): stdout: | (launched: 2022-12-14_07:58:15.031243) 07:58:15.528273 run osmo-nitb_10.42.42.2(pid=25891): stderr: | (launched: 2022-12-14_07:58:15.075902) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:58:15.665336 run osmo-nitb_10.42.42.2(pid=25891): stdout: | (launched: 2022-12-14_07:58:15.031243) 07:58:15.796064 run osmo-nitb_10.42.42.2(pid=25891): stderr: | (launched: 2022-12-14_07:58:15.075902) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25891): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25891) [trial-2401↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25891)] 07:58:16.201490 tst osmo-nitb_10.42.42.2(pid=25891): stdout: | (launched: 2022-12-14_07:58:15.031243) 07:58:16.327759 tst osmo-nitb_10.42.42.2(pid=25891): stderr: | (launched: 2022-12-14_07:58:15.075902) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:58:16.475097 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25891): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25891) [trial-2401↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25891)] [trial-2401↪nitb_sms:nanobts↪mo_mt_sms.py:11] 07:58:16.484213 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 07:58:16.491451 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25890): Terminating (SIGTERM) 07:58:16.702519 --- ParallelTerminationStrategy: PID 25890 died... 07:58:16.722878 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25890): Terminated: ok {rc=0} 07:58:16.813639 bus /sierra_3: Setting Powered False 07:58:17.910518 bus /sierra_3: Setting Powered False 07:58:19.025665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 sms:nanobts+band-1900 --------------------------------------------------------------------- 07:58:20.215430 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:58:20.221032 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:58:20.245483 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 07:58:20.273639 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 07:58:20.327622 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:58:20.351587 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 07:58:20.377641 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 07:58:20.926838 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 07:58:20.931990 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:20.943297 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:58:20.982455 tst mo_mt_sms.py: using LAC 39507 07:58:21.110079 tst mo_mt_sms.py: using RAC 237 07:58:21.237821 tst mo_mt_sms.py: using CellId 39507 07:58:21.357137 tst mo_mt_sms.py: using BVCI 39508 07:58:21.467834 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.478738 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.489537 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.500370 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.510957 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:21.521475 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 07:58:21.643495 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 07:58:21.762462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:22.232103 run create_hlr_db(pid=25895): Launched 07:58:22.356602 bus /sierra_2: Setting Powered False 07:58:23.416930 run create_hlr_db(pid=25895): Terminated: ok {rc=0} 07:58:23.862379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25897): Launched 07:58:24.189533 run osmo-hlr_10.42.42.2(pid=25898): Launched 07:58:24.315385 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:24.873330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25900): Launched 07:58:25.200927 run osmo-stp_10.42.42.5(pid=25901): Launched 07:58:25.327518 run osmo-msc_10.42.42.6: Starting osmo-msc 07:58:25.915636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25903): Launched 07:58:26.244550 run osmo-msc_10.42.42.6(pid=25904): Launched 07:58:26.427707 run osmo-stp_10.42.42.5(pid=25901): ERR: Terminated: ERROR {rc=1} [trial-2401↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25901)] 07:58:26.564472 run osmo-stp_10.42.42.5(pid=25901): stdout: | (launched: 2022-12-14_07:58:25.140592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:26.701665 run osmo-stp_10.42.42.5(pid=25901): stderr: | 20221214075825334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075825334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075825335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075825335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075825336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075825336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075825336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:26.837782 run osmo-stp_10.42.42.5(pid=25901): stdout: | (launched: 2022-12-14_07:58:25.140592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:26.966657 run osmo-stp_10.42.42.5(pid=25901): stderr: | 20221214075825334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075825334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075825335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075825335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075825336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075825336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075825336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:27.121953 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25901): Process ended prematurely: osmo-stp_10.42.42.5(pid=25901) [trial-2401↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25901)] [trial-2401↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 07:58:27.130950 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 07:58:27.158337 run osmo-hlr_10.42.42.2(pid=25898): ERR: Terminated: ERROR {rc=237} [trial-2401↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25898)] 07:58:27.208818 run osmo-hlr_10.42.42.2(pid=25898): stdout: | (launched: 2022-12-14_07:58:24.128643) 07:58:27.261722 run osmo-hlr_10.42.42.2(pid=25898): stderr: | 20221214075824326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075824326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075824327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075824327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075824327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075824327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075824339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075824347 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075824348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075824348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:27.334339 run osmo-msc_10.42.42.6(pid=25904): ERR: Terminated: ERROR {rc=2} [trial-2401↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25904)] 07:58:27.384181 run osmo-msc_10.42.42.6(pid=25904): stdout: | (launched: 2022-12-14_07:58:26.183758) 07:58:27.436548 run osmo-msc_10.42.42.6(pid=25904): stderr: | 20221214075826506 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075826506 DLGLOBAL DEBUG validating counter group 0x7f1b99d6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075826506 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075826506 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075826507 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075826507 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075826508 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075826509 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075826509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075826509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:58:27.489147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25897): Terminating (SIGTERM) 07:58:27.531154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25900): Terminating (SIGTERM) 07:58:27.573347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25903): Terminating (SIGTERM) 07:58:27.615723 --- ParallelTerminationStrategy: PID 25897 died... 07:58:27.636156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25897): Terminated: ok {rc=0} 07:58:27.682850 --- ParallelTerminationStrategy: PID 25900 died... 07:58:27.702567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25900): Terminated: ok {rc=0} 07:58:27.749025 --- ParallelTerminationStrategy: PID 25903 died... 07:58:27.768787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25903): Terminated: ok {rc=0} 07:58:27.858118 bus /sierra_3: Setting Powered False 07:58:28.956343 bus /sierra_3: Setting Powered False 07:58:30.073426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 07:58:31.301239 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:58:31.307118 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:58:31.333171 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 07:58:31.343041 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 07:58:31.386384 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:58:31.417243 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 07:58:31.426385 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 07:58:31.933855 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 07:58:31.944765 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 07:58:31.963011 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:58:32.008849 tst assert_extension.py: using LAC 39508 07:58:32.162945 tst assert_extension.py: using RAC 238 07:58:32.283561 tst assert_extension.py: using CellId 39508 07:58:32.405117 tst assert_extension.py: using BVCI 39509 07:58:32.514339 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 07:58:32.635311 tst assert_extension.py:10: start nitb and bts... 07:58:32.854487 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:58:33.514659 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25909): Launched 07:58:33.840120 run osmo-nitb_10.42.42.2(pid=25910): Launched 07:58:34.021223 run osmo-nitb_10.42.42.2(pid=25910): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25910)] 07:58:34.165958 run osmo-nitb_10.42.42.2(pid=25910): stdout: | (launched: 2022-12-14_07:58:33.780229) 07:58:34.312667 run osmo-nitb_10.42.42.2(pid=25910): stderr: | (launched: 2022-12-14_07:58:33.828262) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:58:34.459112 run osmo-nitb_10.42.42.2(pid=25910): stdout: | (launched: 2022-12-14_07:58:33.780229) 07:58:34.599207 run osmo-nitb_10.42.42.2(pid=25910): stderr: | (launched: 2022-12-14_07:58:33.828262) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25910): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25910) [trial-2401↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25910)] 07:58:34.963749 tst osmo-nitb_10.42.42.2(pid=25910): stdout: | (launched: 2022-12-14_07:58:33.780229) 07:58:35.095212 tst osmo-nitb_10.42.42.2(pid=25910): stderr: | (launched: 2022-12-14_07:58:33.828262) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:58:35.251306 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25910): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25910) [trial-2401↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25910)] [trial-2401↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 07:58:35.260440 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:58:35.267859 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25909): Terminating (SIGTERM) 07:58:35.480343 --- ParallelTerminationStrategy: PID 25909 died... 07:58:35.502094 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25909): Terminated: ok {rc=0} 07:58:35.593325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 ussd:nanobts+band-1900 --------------------------------------------------------------------- 07:58:36.760236 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:58:36.766175 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:58:36.790509 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 07:58:36.818402 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 07:58:36.855004 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:58:36.879640 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 07:58:36.907013 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 07:58:37.436588 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 07:58:37.441981 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:37.453218 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:58:37.491887 tst assert_extension.py: using LAC 39509 07:58:37.620587 tst assert_extension.py: using RAC 239 07:58:37.747748 tst assert_extension.py: using CellId 39509 07:58:37.876074 tst assert_extension.py: using BVCI 39510 07:58:37.995388 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:38.006682 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:38.017806 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:38.028772 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:38.040179 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:58:38.051546 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 07:58:38.168941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:38.637861 run create_hlr_db(pid=25914): Launched 07:58:38.763052 bus /sierra_2: Setting Powered False 07:58:39.822637 run create_hlr_db(pid=25914): Terminated: ok {rc=0} 07:58:40.269756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25916): Launched 07:58:40.595129 run osmo-hlr_10.42.42.2(pid=25917): Launched 07:58:40.720269 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:41.283383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25919): Launched 07:58:41.608137 run osmo-stp_10.42.42.5(pid=25920): Launched 07:58:41.735438 run osmo-msc_10.42.42.6: Starting osmo-msc 07:58:42.321632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25922): Launched 07:58:42.649095 run osmo-msc_10.42.42.6(pid=25923): Launched 07:58:42.831281 run osmo-stp_10.42.42.5(pid=25920): ERR: Terminated: ERROR {rc=1} [trial-2401↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25920)] 07:58:42.967468 run osmo-stp_10.42.42.5(pid=25920): stdout: | (launched: 2022-12-14_07:58:41.548049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:43.104309 run osmo-stp_10.42.42.5(pid=25920): stderr: | 20221214075841741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075841741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075841742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075841742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075841743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075841743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075841743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:43.240729 run osmo-stp_10.42.42.5(pid=25920): stdout: | (launched: 2022-12-14_07:58:41.548049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:43.369540 run osmo-stp_10.42.42.5(pid=25920): stderr: | 20221214075841741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075841741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075841742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075841742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075841743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075841743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075841743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:43.523623 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25920): Process ended prematurely: osmo-stp_10.42.42.5(pid=25920) [trial-2401↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25920)] [trial-2401↪ussd:nanobts+band-1900↪assert_extension.py:17] 07:58:43.532612 tst assert_extension.py:17: Test FAILED (6.1 sec) 07:58:43.560038 run osmo-hlr_10.42.42.2(pid=25917): ERR: Terminated: ERROR {rc=237} [trial-2401↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25917)] 07:58:43.611216 run osmo-hlr_10.42.42.2(pid=25917): stdout: | (launched: 2022-12-14_07:58:40.535140) 07:58:43.664107 run osmo-hlr_10.42.42.2(pid=25917): stderr: | 20221214075840735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075840735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075840735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075840735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075840735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075840735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075840747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075840755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075840756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075840756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:43.736701 run osmo-msc_10.42.42.6(pid=25923): ERR: Terminated: ERROR {rc=2} [trial-2401↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25923)] 07:58:43.786850 run osmo-msc_10.42.42.6(pid=25923): stdout: | (launched: 2022-12-14_07:58:42.588561) 07:58:43.839333 run osmo-msc_10.42.42.6(pid=25923): stderr: | 20221214075842913 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075842913 DLGLOBAL DEBUG validating counter group 0x7f8126238c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075842913 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075842913 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075842913 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075842913 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075842915 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075842915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075842915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075842916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:58:43.891885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25916): Terminating (SIGTERM) 07:58:43.934095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25919): Terminating (SIGTERM) 07:58:43.976731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25922): Terminating (SIGTERM) 07:58:44.019440 --- ParallelTerminationStrategy: PID 25916 died... 07:58:44.039911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25916): Terminated: ok {rc=0} 07:58:44.086866 --- ParallelTerminationStrategy: PID 25919 died... 07:58:44.106812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25919): Terminated: ok {rc=0} 07:58:44.153434 --- ParallelTerminationStrategy: PID 25922 died... 07:58:44.173436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25922): Terminated: ok {rc=0} 07:58:44.261924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:58:45.467596 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:58:45.475972 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:58:45.500508 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:58:45.529273 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:58:45.583066 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:58:45.606911 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:58:45.633736 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:58:46.209280 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:58:46.279258 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:46.292430 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:58:46.361343 tst mo_mt_call.py: using LAC 39510 07:58:46.518616 tst mo_mt_call.py: using RAC 240 07:58:46.642036 tst mo_mt_call.py: using CellId 39510 07:58:46.769331 tst mo_mt_call.py: using BVCI 39511 07:58:46.901242 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:46.914492 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:46.927361 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:46.940144 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:46.953679 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:46.967245 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:58:47.095345 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:58:47.221844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:47.704340 run create_hlr_db(pid=25928): Launched 07:58:47.831317 bus /sierra_2: Setting Powered False 07:58:48.892830 run create_hlr_db(pid=25928): Terminated: ok {rc=0} 07:58:49.321642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25930): Launched 07:58:49.633075 run osmo-hlr_10.42.42.2(pid=25931): Launched 07:58:49.751419 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:50.280557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25933): Launched 07:58:50.589600 run osmo-stp_10.42.42.5(pid=25934): Launched 07:58:50.707398 run osmo-msc_10.42.42.6: Starting osmo-msc 07:58:51.267712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25936): Launched 07:58:51.578447 run osmo-msc_10.42.42.6(pid=25937): Launched 07:58:51.754498 run osmo-stp_10.42.42.5(pid=25934): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25934)] 07:58:51.883986 run osmo-stp_10.42.42.5(pid=25934): stdout: | (launched: 2022-12-14_07:58:50.532270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:52.014169 run osmo-stp_10.42.42.5(pid=25934): stderr: | 20221214075850704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075850704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075850704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075850704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075850705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075850705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075850705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:52.142020 run osmo-stp_10.42.42.5(pid=25934): stdout: | (launched: 2022-12-14_07:58:50.532270) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:52.264298 run osmo-stp_10.42.42.5(pid=25934): stderr: | 20221214075850704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075850704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075850704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075850704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075850705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075850705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075850705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:52.410368 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25934): Process ended prematurely: osmo-stp_10.42.42.5(pid=25934) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25934)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:58:52.419472 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:58:52.446061 run osmo-hlr_10.42.42.2(pid=25931): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25931)] 07:58:52.494499 run osmo-hlr_10.42.42.2(pid=25931): stdout: | (launched: 2022-12-14_07:58:49.575360) 07:58:52.543657 run osmo-hlr_10.42.42.2(pid=25931): stderr: | 20221214075849754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075849754 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075849754 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075849754 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075849754 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075849754 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075849785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075849795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075849795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075849795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:52.612455 run osmo-msc_10.42.42.6(pid=25937): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25937)] 07:58:52.660295 run osmo-msc_10.42.42.6(pid=25937): stdout: | (launched: 2022-12-14_07:58:51.520529) 07:58:52.709699 run osmo-msc_10.42.42.6(pid=25937): stderr: | 20221214075851796 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075851797 DLGLOBAL DEBUG validating counter group 0x7f7d1a6f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075851797 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075851797 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075851797 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075851797 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075851799 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075851799 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075851799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075851799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:58:52.759710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25930): Terminating (SIGTERM) 07:58:52.799434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25933): Terminating (SIGTERM) 07:58:52.838992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25936): Terminating (SIGTERM) 07:58:52.879029 --- ParallelTerminationStrategy: PID 25930 died... 07:58:52.898436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25930): Terminated: ok {rc=0} 07:58:52.942601 --- ParallelTerminationStrategy: PID 25933 died... 07:58:52.961376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25933): Terminated: ok {rc=0} 07:58:53.004868 --- ParallelTerminationStrategy: PID 25936 died... 07:58:53.023935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25936): Terminated: ok {rc=0} 07:58:53.107718 bus /sierra_3: Setting Powered False 07:58:54.206758 bus /sierra_3: Setting Powered False 07:58:55.323520 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:58:56.473802 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:56.486797 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:58:56.554679 tst mo_mt_call_osmux.py: using LAC 39511 07:58:56.684639 tst mo_mt_call_osmux.py: using RAC 241 07:58:56.812396 tst mo_mt_call_osmux.py: using CellId 39511 07:58:56.940298 tst mo_mt_call_osmux.py: using BVCI 39512 07:58:57.059888 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:57.071666 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:57.083166 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:57.094828 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:57.106875 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:58:57.118755 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:58:57.241529 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:58:57.366050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:57.880336 run create_hlr_db(pid=25939): Launched 07:58:58.008223 bus /sierra_2: Setting Powered False 07:58:59.074406 run create_hlr_db(pid=25939): Terminated: ok {rc=0} 07:58:59.515921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25941): Launched 07:58:59.828081 run osmo-hlr_10.42.42.2(pid=25942): Launched 07:58:59.945457 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:00.476220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25944): Launched 07:59:00.786729 run osmo-stp_10.42.42.5(pid=25945): Launched 07:59:00.914143 run osmo-msc_10.42.42.6: Starting osmo-msc 07:59:01.605402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25947): Launched 07:59:01.933706 run osmo-msc_10.42.42.6(pid=25948): Launched 07:59:02.289419 run osmo-stp_10.42.42.5(pid=25945): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25945)] 07:59:02.429874 run osmo-stp_10.42.42.5(pid=25945): stdout: | (launched: 2022-12-14_07:59:00.728848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:02.599712 run osmo-stp_10.42.42.5(pid=25945): stderr: | 20221214075901013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075901014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075901014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075901014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075901015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075901015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075901015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:02.737847 run osmo-stp_10.42.42.5(pid=25945): stdout: | (launched: 2022-12-14_07:59:00.728848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:02.869762 run osmo-stp_10.42.42.5(pid=25945): stderr: | 20221214075901013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075901014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075901014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075901014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075901015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075901015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075901015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:03.027353 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25945): Process ended prematurely: osmo-stp_10.42.42.5(pid=25945) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25945)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:59:03.037515 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 07:59:03.065748 run osmo-hlr_10.42.42.2(pid=25942): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25942)] 07:59:03.117544 run osmo-hlr_10.42.42.2(pid=25942): stdout: | (launched: 2022-12-14_07:58:59.770158) 07:59:03.170057 run osmo-hlr_10.42.42.2(pid=25942): stderr: | 20221214075859948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075859948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075859948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075859948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075859948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075859948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075859960 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075859968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075859968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075859968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:03.243168 run osmo-msc_10.42.42.6(pid=25948): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25948)] 07:59:03.293998 run osmo-msc_10.42.42.6(pid=25948): stdout: | (launched: 2022-12-14_07:59:01.875519) 07:59:03.346614 run osmo-msc_10.42.42.6(pid=25948): stderr: | 20221214075902173 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075902173 DLGLOBAL DEBUG validating counter group 0x7fdd4587dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075902173 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075902173 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075902173 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075902173 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075902178 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075902178 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075902179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075902179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:59:03.399475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25941): Terminating (SIGTERM) 07:59:03.441859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25944): Terminating (SIGTERM) 07:59:03.484319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25947): Terminating (SIGTERM) 07:59:03.527500 --- ParallelTerminationStrategy: PID 25941 died... 07:59:03.548254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25941): Terminated: ok {rc=0} 07:59:03.595055 --- ParallelTerminationStrategy: PID 25944 died... 07:59:03.615135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25944): Terminated: ok {rc=0} 07:59:03.661780 --- ParallelTerminationStrategy: PID 25947 died... 07:59:03.681987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25947): Terminated: ok {rc=0} 07:59:03.770973 bus /sierra_3: Setting Powered False 07:59:04.870065 bus /sierra_3: Setting Powered False 07:59:05.985514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:59:07.231533 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:59:07.240270 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:59:07.264680 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:59:07.293198 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:59:07.347839 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:59:07.372437 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:59:07.399929 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:59:07.950021 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:59:08.004298 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:08.016182 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:59:08.076832 tst mo_mt_call.py: using LAC 39512 07:59:08.204728 tst mo_mt_call.py: using RAC 242 07:59:08.332897 tst mo_mt_call.py: using CellId 39512 07:59:08.460710 tst mo_mt_call.py: using BVCI 39513 07:59:08.581090 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:08.592904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:08.604658 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:08.616346 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:08.628859 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:08.641337 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:59:08.760293 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:59:08.880710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:09.393786 run create_hlr_db(pid=25953): Launched 07:59:09.520235 bus /sierra_2: Setting Powered False 07:59:10.584368 run create_hlr_db(pid=25953): Terminated: ok {rc=0} 07:59:11.026581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25955): Launched 07:59:11.336830 run osmo-hlr_10.42.42.2(pid=25956): Launched 07:59:11.454910 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:12.009050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25958): Launched 07:59:12.318720 run osmo-stp_10.42.42.5(pid=25959): Launched 07:59:12.435917 run osmo-msc_10.42.42.6: Starting osmo-msc 07:59:12.993521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25961): Launched 07:59:13.306075 run osmo-msc_10.42.42.6(pid=25962): Launched 07:59:13.478564 run osmo-stp_10.42.42.5(pid=25959): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25959)] 07:59:13.607772 run osmo-stp_10.42.42.5(pid=25959): stdout: | (launched: 2022-12-14_07:59:12.260782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:13.737220 run osmo-stp_10.42.42.5(pid=25959): stderr: | 20221214075912433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075912433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075912433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075912434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075912434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075912434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075912434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:13.864668 run osmo-stp_10.42.42.5(pid=25959): stdout: | (launched: 2022-12-14_07:59:12.260782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:13.987019 run osmo-stp_10.42.42.5(pid=25959): stderr: | 20221214075912433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075912433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075912433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075912434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075912434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075912434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075912434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:14.132901 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25959): Process ended prematurely: osmo-stp_10.42.42.5(pid=25959) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25959)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:59:14.141846 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:59:14.168122 run osmo-hlr_10.42.42.2(pid=25956): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25956)] 07:59:14.215428 run osmo-hlr_10.42.42.2(pid=25956): stdout: | (launched: 2022-12-14_07:59:11.278857) 07:59:14.264476 run osmo-hlr_10.42.42.2(pid=25956): stderr: | 20221214075911457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075911457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075911457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075911457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075911457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075911457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075911469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075911477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075911478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075911478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:14.333235 run osmo-msc_10.42.42.6(pid=25962): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25962)] 07:59:14.380758 run osmo-msc_10.42.42.6(pid=25962): stdout: | (launched: 2022-12-14_07:59:13.248051) 07:59:14.429592 run osmo-msc_10.42.42.6(pid=25962): stderr: | 20221214075913523 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075913524 DLGLOBAL DEBUG validating counter group 0x7f4218674c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075913524 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075913524 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075913524 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075913524 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075913526 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075913526 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075913526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075913527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:59:14.478836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25955): Terminating (SIGTERM) 07:59:14.518321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25958): Terminating (SIGTERM) 07:59:14.557872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25961): Terminating (SIGTERM) 07:59:14.597824 --- ParallelTerminationStrategy: PID 25955 died... 07:59:14.616783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25955): Terminated: ok {rc=0} 07:59:14.660521 --- ParallelTerminationStrategy: PID 25958 died... 07:59:14.679031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25958): Terminated: ok {rc=0} 07:59:14.722461 --- ParallelTerminationStrategy: PID 25961 died... 07:59:14.740735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25961): Terminated: ok {rc=0} 07:59:14.827365 bus /sierra_3: Setting Powered False 07:59:15.934822 bus /sierra_3: Setting Powered False 07:59:17.052232 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:59:18.195849 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:18.207695 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:59:18.266346 tst mo_mt_call_osmux.py: using LAC 39513 07:59:18.389111 tst mo_mt_call_osmux.py: using RAC 243 07:59:18.509372 tst mo_mt_call_osmux.py: using CellId 39513 07:59:18.630462 tst mo_mt_call_osmux.py: using BVCI 39514 07:59:18.742981 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:18.754389 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:18.765522 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:18.776619 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:18.787807 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:59:18.798828 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:59:18.921435 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:59:19.044380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:19.557485 run create_hlr_db(pid=25964): Launched 07:59:19.686279 bus /sierra_2: Setting Powered False 07:59:20.750832 run create_hlr_db(pid=25964): Terminated: ok {rc=0} 07:59:21.210164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25966): Launched 07:59:21.542260 run osmo-hlr_10.42.42.2(pid=25967): Launched 07:59:21.671319 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:22.243641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25969): Launched 07:59:22.578253 run osmo-stp_10.42.42.5(pid=25970): Launched 07:59:22.707124 run osmo-msc_10.42.42.6: Starting osmo-msc 07:59:23.308375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25972): Launched 07:59:23.643227 run osmo-msc_10.42.42.6(pid=25973): Launched 07:59:23.829851 run osmo-stp_10.42.42.5(pid=25970): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25970)] 07:59:23.968565 run osmo-stp_10.42.42.5(pid=25970): stdout: | (launched: 2022-12-14_07:59:22.516824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:24.108458 run osmo-stp_10.42.42.5(pid=25970): stderr: | 20221214075922714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075922714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075922714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075922715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075922715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075922715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075922715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:24.246679 run osmo-stp_10.42.42.5(pid=25970): stdout: | (launched: 2022-12-14_07:59:22.516824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:24.378027 run osmo-stp_10.42.42.5(pid=25970): stderr: | 20221214075922714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075922714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075922714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075922715 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075922715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075922715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075922715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:24.535487 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25970): Process ended prematurely: osmo-stp_10.42.42.5(pid=25970) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25970)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:59:24.545434 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:59:24.573623 run osmo-hlr_10.42.42.2(pid=25967): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25967)] 07:59:24.624613 run osmo-hlr_10.42.42.2(pid=25967): stdout: | (launched: 2022-12-14_07:59:21.481354) 07:59:24.677151 run osmo-hlr_10.42.42.2(pid=25967): stderr: | 20221214075921682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075921682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075921683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075921683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075921683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075921683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075921695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075921703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075921704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075921704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:24.749498 run osmo-msc_10.42.42.6(pid=25973): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25973)] 07:59:24.799303 run osmo-msc_10.42.42.6(pid=25973): stdout: | (launched: 2022-12-14_07:59:23.582032) 07:59:24.851383 run osmo-msc_10.42.42.6(pid=25973): stderr: | 20221214075923906 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075923907 DLGLOBAL DEBUG validating counter group 0x7f688ed14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075923907 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075923907 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075923907 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075923907 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075923909 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075923909 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075923909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075923910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:59:24.904386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25966): Terminating (SIGTERM) 07:59:24.946269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25969): Terminating (SIGTERM) 07:59:24.988488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25972): Terminating (SIGTERM) 07:59:25.031043 --- ParallelTerminationStrategy: PID 25966 died... 07:59:25.051610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25966): Terminated: ok {rc=0} 07:59:25.098369 --- ParallelTerminationStrategy: PID 25969 died... 07:59:25.118527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25969): Terminated: ok {rc=0} 07:59:25.165060 --- ParallelTerminationStrategy: PID 25972 died... 07:59:25.185314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25972): Terminated: ok {rc=0} 07:59:25.274147 bus /sierra_3: Setting Powered False 07:59:26.373642 bus /sierra_3: Setting Powered False 07:59:27.490187 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:59:28.735843 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:59:28.744242 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:59:28.768839 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:59:28.797165 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:59:28.851452 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:59:28.876351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:59:28.903843 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:59:29.454774 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:59:29.509257 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:29.521275 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:59:29.584410 tst mo_mt_call.py: using LAC 39514 07:59:29.716440 tst mo_mt_call.py: using RAC 244 07:59:29.846468 tst mo_mt_call.py: using CellId 39514 07:59:29.975797 tst mo_mt_call.py: using BVCI 39515 07:59:30.098705 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:30.110696 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:30.122321 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:30.133926 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:30.146216 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:30.158267 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:59:30.276910 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:59:30.398361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:30.882069 run create_hlr_db(pid=25979): Launched 07:59:31.036662 bus /sierra_2: Setting Powered False 07:59:32.113806 run create_hlr_db(pid=25979): Terminated: ok {rc=0} 07:59:32.596644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25981): Launched 07:59:32.930858 run osmo-hlr_10.42.42.2(pid=25982): Launched 07:59:33.057553 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:33.629095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Launched 07:59:33.961068 run osmo-stp_10.42.42.5(pid=25985): Launched 07:59:34.088215 run osmo-msc_10.42.42.6: Starting osmo-msc 07:59:34.684311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25987): Launched 07:59:35.017263 run osmo-msc_10.42.42.6(pid=25988): Launched 07:59:35.202511 run osmo-stp_10.42.42.5(pid=25985): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] 07:59:35.341462 run osmo-stp_10.42.42.5(pid=25985): stdout: | (launched: 2022-12-14_07:59:33.899982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:35.480677 run osmo-stp_10.42.42.5(pid=25985): stderr: | 20221214075934095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075934096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075934096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075934096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075934097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075934097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075934097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:35.619063 run osmo-stp_10.42.42.5(pid=25985): stdout: | (launched: 2022-12-14_07:59:33.899982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:35.749407 run osmo-stp_10.42.42.5(pid=25985): stderr: | 20221214075934095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075934096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075934096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075934096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075934097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075934097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075934097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:35.905734 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25985): Process ended prematurely: osmo-stp_10.42.42.5(pid=25985) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:59:35.915339 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:59:35.943407 run osmo-hlr_10.42.42.2(pid=25982): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25982)] 07:59:35.994305 run osmo-hlr_10.42.42.2(pid=25982): stdout: | (launched: 2022-12-14_07:59:32.869332) 07:59:36.046565 run osmo-hlr_10.42.42.2(pid=25982): stderr: | 20221214075933071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075933071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075933071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075933071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075933071 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075933071 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075933084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075933094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075933094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075933094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:36.119305 run osmo-msc_10.42.42.6(pid=25988): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25988)] 07:59:36.169229 run osmo-msc_10.42.42.6(pid=25988): stdout: | (launched: 2022-12-14_07:59:34.955956) 07:59:36.220814 run osmo-msc_10.42.42.6(pid=25988): stderr: | 20221214075935281 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075935281 DLGLOBAL DEBUG validating counter group 0x7f1070ca1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075935282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075935282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075935282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075935282 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075935284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075935284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075935284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075935284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:59:36.273779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25981): Terminating (SIGTERM) 07:59:36.315547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Terminating (SIGTERM) 07:59:36.357810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25987): Terminating (SIGTERM) 07:59:36.400242 --- ParallelTerminationStrategy: PID 25981 died... 07:59:36.420705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25981): Terminated: ok {rc=0} 07:59:36.467427 --- ParallelTerminationStrategy: PID 25984 died... 07:59:36.487417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25984): Terminated: ok {rc=0} 07:59:36.533677 --- ParallelTerminationStrategy: PID 25987 died... 07:59:36.553591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25987): Terminated: ok {rc=0} 07:59:36.641413 bus /sierra_3: Setting Powered False 07:59:37.740803 bus /sierra_3: Setting Powered False 07:59:38.854784 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:59:40.002642 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:40.014624 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:59:40.078053 tst mo_mt_call_osmux.py: using LAC 39515 07:59:40.198242 tst mo_mt_call_osmux.py: using RAC 245 07:59:40.328135 tst mo_mt_call_osmux.py: using CellId 39515 07:59:40.457489 tst mo_mt_call_osmux.py: using BVCI 39516 07:59:40.579122 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:40.591225 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:40.603123 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:40.614841 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:40.627128 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:59:40.639351 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:59:40.759918 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:59:40.882962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:41.396288 run create_hlr_db(pid=25990): Launched 07:59:41.522752 bus /sierra_2: Setting Powered False 07:59:42.587876 run create_hlr_db(pid=25990): Terminated: ok {rc=0} 07:59:43.028696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25992): Launched 07:59:43.338673 run osmo-hlr_10.42.42.2(pid=25993): Launched 07:59:43.456215 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:43.993510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25995): Launched 07:59:44.306543 run osmo-stp_10.42.42.5(pid=25996): Launched 07:59:44.426709 run osmo-msc_10.42.42.6: Starting osmo-msc 07:59:45.010726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25998): Launched 07:59:45.323710 run osmo-msc_10.42.42.6(pid=25999): Launched 07:59:45.498744 run osmo-stp_10.42.42.5(pid=25996): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25996)] 07:59:45.629904 run osmo-stp_10.42.42.5(pid=25996): stdout: | (launched: 2022-12-14_07:59:44.248236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:45.760571 run osmo-stp_10.42.42.5(pid=25996): stderr: | 20221214075944423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075944423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075944424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075944424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075944424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075944425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075944425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:45.918942 run osmo-stp_10.42.42.5(pid=25996): stdout: | (launched: 2022-12-14_07:59:44.248236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:46.060226 run osmo-stp_10.42.42.5(pid=25996): stderr: | 20221214075944423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075944423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075944424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075944424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075944424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075944425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075944425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:46.223436 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25996): Process ended prematurely: osmo-stp_10.42.42.5(pid=25996) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25996)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:59:46.234426 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:59:46.264886 run osmo-hlr_10.42.42.2(pid=25993): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25993)] 07:59:46.320077 run osmo-hlr_10.42.42.2(pid=25993): stdout: | (launched: 2022-12-14_07:59:43.281377) 07:59:46.375287 run osmo-hlr_10.42.42.2(pid=25993): stderr: | 20221214075943459 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075943459 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075943459 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075943459 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075943459 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075943459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075943471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075943479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075943480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075943480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:46.451812 run osmo-msc_10.42.42.6(pid=25999): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25999)] 07:59:46.504497 run osmo-msc_10.42.42.6(pid=25999): stdout: | (launched: 2022-12-14_07:59:45.265857) 07:59:46.559807 run osmo-msc_10.42.42.6(pid=25999): stderr: | 20221214075945539 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075945539 DLGLOBAL DEBUG validating counter group 0x7f6b5c829c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075945539 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075945539 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075945539 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075945540 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075945542 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075945542 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075945542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075945542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:59:46.615815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25992): Terminating (SIGTERM) 07:59:46.660173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25995): Terminating (SIGTERM) 07:59:46.706794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25998): Terminating (SIGTERM) 07:59:46.753695 --- ParallelTerminationStrategy: PID 25992 died... 07:59:46.776812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25992): Terminated: ok {rc=0} 07:59:46.829078 --- ParallelTerminationStrategy: PID 25995 died... 07:59:46.849956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25995): Terminated: ok {rc=0} 07:59:46.899672 --- ParallelTerminationStrategy: PID 25998 died... 07:59:46.920242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25998): Terminated: ok {rc=0} 07:59:47.013716 bus /sierra_3: Setting Powered False 07:59:48.115486 bus /sierra_3: Setting Powered False 07:59:49.233546 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:59:50.473214 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:59:50.480425 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:59:50.504188 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:59:50.530935 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:59:50.581777 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:59:50.605793 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:59:50.632612 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:59:51.187301 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:59:51.241434 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:59:51.253420 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:59:51.316035 tst mo_mt_call.py: using LAC 39516 07:59:51.446420 tst mo_mt_call.py: using RAC 246 07:59:51.578290 tst mo_mt_call.py: using CellId 39516 07:59:51.699381 tst mo_mt_call.py: using BVCI 39517 07:59:51.811578 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:59:51.823040 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:59:51.834223 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:59:51.845561 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:59:51.856820 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:59:51.868020 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:59:51.989217 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:59:52.109581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:52.620685 run create_hlr_db(pid=26004): Launched 07:59:52.749218 bus /sierra_2: Setting Powered False 07:59:53.813951 run create_hlr_db(pid=26004): Terminated: ok {rc=0} 07:59:54.254254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26006): Launched 07:59:54.562878 run osmo-hlr_10.42.42.2(pid=26007): Launched 07:59:54.680847 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:55.229904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26009): Launched 07:59:55.538464 run osmo-stp_10.42.42.5(pid=26010): Launched 07:59:55.658659 run osmo-msc_10.42.42.6: Starting osmo-msc 07:59:56.215696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26012): Launched 07:59:56.526797 run osmo-msc_10.42.42.6(pid=26013): Launched 07:59:56.701650 run osmo-stp_10.42.42.5(pid=26010): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26010)] 07:59:56.830782 run osmo-stp_10.42.42.5(pid=26010): stdout: | (launched: 2022-12-14_07:59:55.481269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:56.960113 run osmo-stp_10.42.42.5(pid=26010): stderr: | 20221214075955656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075955656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075955656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075955657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075955657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075955657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075955658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:57.087843 run osmo-stp_10.42.42.5(pid=26010): stdout: | (launched: 2022-12-14_07:59:55.481269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:57.209368 run osmo-stp_10.42.42.5(pid=26010): stderr: | 20221214075955656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214075955656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214075955656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214075955657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214075955657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214075955657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214075955658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:57.355169 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26010): Process ended prematurely: osmo-stp_10.42.42.5(pid=26010) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26010)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:59:57.364390 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:59:57.390969 run osmo-hlr_10.42.42.2(pid=26007): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26007)] 07:59:57.438899 run osmo-hlr_10.42.42.2(pid=26007): stdout: | (launched: 2022-12-14_07:59:54.505490) 07:59:57.488560 run osmo-hlr_10.42.42.2(pid=26007): stderr: | 20221214075954682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214075954682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214075954682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214075954682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214075954683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214075954683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214075954695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214075954706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214075954706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214075954706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:57.558045 run osmo-msc_10.42.42.6(pid=26013): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26013)] 07:59:57.605634 run osmo-msc_10.42.42.6(pid=26013): stdout: | (launched: 2022-12-14_07:59:56.469208) 07:59:57.654840 run osmo-msc_10.42.42.6(pid=26013): stderr: | 20221214075956741 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214075956741 DLGLOBAL DEBUG validating counter group 0x7f5d9dd4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214075956741 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214075956741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214075956741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214075956741 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214075956743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214075956743 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214075956744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214075956744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:59:57.704756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26006): Terminating (SIGTERM) 07:59:57.744644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26009): Terminating (SIGTERM) 07:59:57.784273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26012): Terminating (SIGTERM) 07:59:57.824408 --- ParallelTerminationStrategy: PID 26006 died... 07:59:57.843476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26006): Terminated: ok {rc=0} 07:59:57.887081 --- ParallelTerminationStrategy: PID 26009 died... 07:59:57.905555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26009): Terminated: ok {rc=0} 07:59:57.948843 --- ParallelTerminationStrategy: PID 26012 died... 07:59:57.967735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26012): Terminated: ok {rc=0} 07:59:58.052783 bus /sierra_3: Setting Powered False 07:59:59.151523 bus /sierra_3: Setting Powered False 08:00:00.264888 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:00:01.434083 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:00:01.450330 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:00:01.523667 tst mo_mt_call_osmux.py: using LAC 39517 08:00:01.677060 tst mo_mt_call_osmux.py: using RAC 247 08:00:01.816186 tst mo_mt_call_osmux.py: using CellId 39517 08:00:01.948560 tst mo_mt_call_osmux.py: using BVCI 39518 08:00:02.110779 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:00:02.126122 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:00:02.143552 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:00:02.160611 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:00:02.176343 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:00:02.192116 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:00:02.321323 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:00:02.444493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:02.956083 run create_hlr_db(pid=26018): Launched 08:00:03.084837 bus /sierra_2: Setting Powered False 08:00:04.150672 run create_hlr_db(pid=26018): Terminated: ok {rc=0} 08:00:04.593208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26020): Launched 08:00:04.904218 run osmo-hlr_10.42.42.2(pid=26021): Launched 08:00:05.034292 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:05.606047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26023): Launched 08:00:05.940085 run osmo-stp_10.42.42.5(pid=26024): Launched 08:00:06.068071 run osmo-msc_10.42.42.6: Starting osmo-msc 08:00:06.666781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26026): Launched 08:00:06.999151 run osmo-msc_10.42.42.6(pid=26027): Launched 08:00:07.184806 run osmo-stp_10.42.42.5(pid=26024): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26024)] 08:00:07.325246 run osmo-stp_10.42.42.5(pid=26024): stdout: | (launched: 2022-12-14_08:00:05.878875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:07.465459 run osmo-stp_10.42.42.5(pid=26024): stderr: | 20221214080006074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080006074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080006074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080006075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080006075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080006075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080006075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:07.604094 run osmo-stp_10.42.42.5(pid=26024): stdout: | (launched: 2022-12-14_08:00:05.878875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:07.735113 run osmo-stp_10.42.42.5(pid=26024): stderr: | 20221214080006074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080006074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080006074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080006075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080006075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080006075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080006075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:07.891755 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26024): Process ended prematurely: osmo-stp_10.42.42.5(pid=26024) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26024)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:00:07.901761 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 08:00:07.929552 run osmo-hlr_10.42.42.2(pid=26021): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26021)] 08:00:07.980211 run osmo-hlr_10.42.42.2(pid=26021): stdout: | (launched: 2022-12-14_08:00:04.846260) 08:00:08.032583 run osmo-hlr_10.42.42.2(pid=26021): stderr: | 20221214080005041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080005041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080005041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080005041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080005041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080005041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080005054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080005062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080005062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080005062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:08.105152 run osmo-msc_10.42.42.6(pid=26027): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26027)] 08:00:08.155093 run osmo-msc_10.42.42.6(pid=26027): stdout: | (launched: 2022-12-14_08:00:06.937741) 08:00:08.207243 run osmo-msc_10.42.42.6(pid=26027): stderr: | 20221214080007259 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080007259 DLGLOBAL DEBUG validating counter group 0x7fb41cc30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080007259 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080007259 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080007259 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080007259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080007261 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080007261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080007262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080007262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:00:08.259558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26020): Terminating (SIGTERM) 08:00:08.301693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26023): Terminating (SIGTERM) 08:00:08.344071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26026): Terminating (SIGTERM) 08:00:08.386465 --- ParallelTerminationStrategy: PID 26020 died... 08:00:08.406968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26020): Terminated: ok {rc=0} 08:00:08.453481 --- ParallelTerminationStrategy: PID 26023 died... 08:00:08.473476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26023): Terminated: ok {rc=0} 08:00:08.519606 --- ParallelTerminationStrategy: PID 26026 died... 08:00:08.539596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26026): Terminated: ok {rc=0} 08:00:08.627816 bus /sierra_3: Setting Powered False 08:00:09.727297 bus /sierra_3: Setting Powered False 08:00:10.844920 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:00:12.088600 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:00:12.096924 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:00:12.121565 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:00:12.150140 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:00:12.203572 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:00:12.228271 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:00:12.256231 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:00:12.805867 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:00:12.855601 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:12.866981 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:00:12.927292 tst mo_mt_call.py: using LAC 39518 08:00:13.047231 tst mo_mt_call.py: using RAC 248 08:00:13.169131 tst mo_mt_call.py: using CellId 39518 08:00:13.288659 tst mo_mt_call.py: using BVCI 39519 08:00:13.400235 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:13.411480 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:13.422625 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:13.433749 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:13.444934 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:13.456046 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:00:13.578771 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:00:13.701644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:14.213143 run create_hlr_db(pid=26032): Launched 08:00:14.342282 bus /sierra_2: Setting Powered False 08:00:15.407378 run create_hlr_db(pid=26032): Terminated: ok {rc=0} 08:00:15.853841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26034): Launched 08:00:16.201800 run osmo-hlr_10.42.42.2(pid=26035): Launched 08:00:16.377036 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:17.097834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26037): Launched 08:00:17.444338 run osmo-stp_10.42.42.5(pid=26038): Launched 08:00:17.573917 run osmo-msc_10.42.42.6: Starting osmo-msc 08:00:18.177210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26040): Launched 08:00:18.510276 run osmo-msc_10.42.42.6(pid=26041): Launched 08:00:18.695129 run osmo-stp_10.42.42.5(pid=26038): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26038)] 08:00:18.834238 run osmo-stp_10.42.42.5(pid=26038): stdout: | (launched: 2022-12-14_08:00:17.383157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:18.973925 run osmo-stp_10.42.42.5(pid=26038): stderr: | 20221214080017577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080017577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080017578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080017578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080017579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080017579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080017579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:19.111737 run osmo-stp_10.42.42.5(pid=26038): stdout: | (launched: 2022-12-14_08:00:17.383157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:19.242511 run osmo-stp_10.42.42.5(pid=26038): stderr: | 20221214080017577 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080017577 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080017578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080017578 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080017579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080017579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080017579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:19.399858 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26038): Process ended prematurely: osmo-stp_10.42.42.5(pid=26038) [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26038)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:00:19.409870 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 08:00:19.438149 run osmo-hlr_10.42.42.2(pid=26035): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26035)] 08:00:19.489757 run osmo-hlr_10.42.42.2(pid=26035): stdout: | (launched: 2022-12-14_08:00:16.136547) 08:00:19.542515 run osmo-hlr_10.42.42.2(pid=26035): stderr: | 20221214080016483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080016483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080016484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080016484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080016484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080016484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080016514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080016530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080016530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080016530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:19.615785 run osmo-msc_10.42.42.6(pid=26041): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26041)] 08:00:19.666142 run osmo-msc_10.42.42.6(pid=26041): stdout: | (launched: 2022-12-14_08:00:18.448826) 08:00:19.718846 run osmo-msc_10.42.42.6(pid=26041): stderr: | 20221214080018771 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080018771 DLGLOBAL DEBUG validating counter group 0x7fb41b0dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080018771 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080018771 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080018771 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080018772 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080018773 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080018774 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080018774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080018774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:00:19.771732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26034): Terminating (SIGTERM) 08:00:19.813820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26037): Terminating (SIGTERM) 08:00:19.856063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26040): Terminating (SIGTERM) 08:00:19.898755 --- ParallelTerminationStrategy: PID 26034 died... 08:00:19.919369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26034): Terminated: ok {rc=0} 08:00:19.966447 --- ParallelTerminationStrategy: PID 26037 died... 08:00:19.986586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26037): Terminated: ok {rc=0} 08:00:20.033217 --- ParallelTerminationStrategy: PID 26040 died... 08:00:20.053102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26040): Terminated: ok {rc=0} 08:00:20.142320 bus /sierra_3: Setting Powered False 08:00:21.242221 bus /sierra_3: Setting Powered False 08:00:22.358743 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:00:23.510313 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:23.523090 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:00:23.585590 tst mo_mt_call_osmux.py: using LAC 39519 08:00:23.714864 tst mo_mt_call_osmux.py: using RAC 249 08:00:23.845363 tst mo_mt_call_osmux.py: using CellId 39519 08:00:23.973874 tst mo_mt_call_osmux.py: using BVCI 39520 08:00:24.093997 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:24.105780 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:24.117292 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:24.128713 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:24.140821 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:00:24.152734 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:00:24.275618 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:00:24.393980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:24.874445 run create_hlr_db(pid=26043): Launched 08:00:25.004710 bus /sierra_2: Setting Powered False 08:00:26.069399 run create_hlr_db(pid=26043): Terminated: ok {rc=0} 08:00:26.512857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26045): Launched 08:00:26.822371 run osmo-hlr_10.42.42.2(pid=26046): Launched 08:00:26.939340 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:27.470924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26048): Launched 08:00:27.780530 run osmo-stp_10.42.42.5(pid=26049): Launched 08:00:27.898869 run osmo-msc_10.42.42.6: Starting osmo-msc 08:00:28.456619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26051): Launched 08:00:28.769498 run osmo-msc_10.42.42.6(pid=26052): Launched 08:00:28.946168 run osmo-stp_10.42.42.5(pid=26049): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26049)] 08:00:29.077726 run osmo-stp_10.42.42.5(pid=26049): stdout: | (launched: 2022-12-14_08:00:27.723023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:29.208335 run osmo-stp_10.42.42.5(pid=26049): stderr: | 20221214080027894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080027894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080027895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080027895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080027897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080027897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080027897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:29.337098 run osmo-stp_10.42.42.5(pid=26049): stdout: | (launched: 2022-12-14_08:00:27.723023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:29.459525 run osmo-stp_10.42.42.5(pid=26049): stderr: | 20221214080027894 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080027894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080027895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080027895 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080027897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080027897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080027897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:29.606557 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26049): Process ended prematurely: osmo-stp_10.42.42.5(pid=26049) [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26049)] [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:00:29.615479 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:00:29.642146 run osmo-hlr_10.42.42.2(pid=26046): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26046)] 08:00:29.689820 run osmo-hlr_10.42.42.2(pid=26046): stdout: | (launched: 2022-12-14_08:00:26.764905) 08:00:29.739000 run osmo-hlr_10.42.42.2(pid=26046): stderr: | 20221214080026942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080026942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080026942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080026942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080026942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080026942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080027001 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080027010 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080027010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080027010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:29.808718 run osmo-msc_10.42.42.6(pid=26052): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26052)] 08:00:29.856110 run osmo-msc_10.42.42.6(pid=26052): stdout: | (launched: 2022-12-14_08:00:28.711644) 08:00:29.905330 run osmo-msc_10.42.42.6(pid=26052): stderr: | 20221214080028984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080028984 DLGLOBAL DEBUG validating counter group 0x7f3df4273c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080028984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080028984 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080028984 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080028984 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080028988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080028988 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080028988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080028989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:00:29.954966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26045): Terminating (SIGTERM) 08:00:29.994875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26048): Terminating (SIGTERM) 08:00:30.034736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26051): Terminating (SIGTERM) 08:00:30.074903 --- ParallelTerminationStrategy: PID 26045 died... 08:00:30.094328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26045): Terminated: ok {rc=0} 08:00:30.138478 --- ParallelTerminationStrategy: PID 26048 died... 08:00:30.157248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26048): Terminated: ok {rc=0} 08:00:30.201289 --- ParallelTerminationStrategy: PID 26051 died... 08:00:30.219923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26051): Terminated: ok {rc=0} 08:00:30.305740 bus /sierra_3: Setting Powered False 08:00:31.412400 bus /sierra_3: Setting Powered False 08:00:32.546748 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 emergency:nanobts+band-1900 --------------------------------------------------------------------- 08:00:33.785787 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:00:33.791001 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 08:00:33.814566 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 08:00:33.841587 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 08:00:33.926478 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 08:00:33.950075 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 08:00:33.976320 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 08:00:34.560388 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2401 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 08:00:34.565407 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:34.576221 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 08:00:34.616104 tst emergency_mo_mt_call.py: using LAC 39520 08:00:34.737607 tst emergency_mo_mt_call.py: using RAC 250 08:00:34.855210 tst emergency_mo_mt_call.py: using CellId 39520 08:00:34.975604 tst emergency_mo_mt_call.py: using BVCI 39521 08:00:35.084320 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:35.095236 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:35.106126 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:35.116797 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:35.127473 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:35.138074 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:00:35.258741 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:00:35.377319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:35.882582 run create_hlr_db(pid=26058): Launched 08:00:36.006791 bus /sierra_2: Setting Powered False 08:00:37.070595 run create_hlr_db(pid=26058): Terminated: ok {rc=0} 08:00:37.506039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26060): Launched 08:00:37.811183 run osmo-hlr_10.42.42.2(pid=26061): Launched 08:00:37.927465 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:38.447580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26063): Launched 08:00:38.752137 run osmo-stp_10.42.42.5(pid=26064): Launched 08:00:38.878912 tst emergency_mo_mt_call.py: using MSISDN 8574 08:00:39.033158 run osmo-msc_10.42.42.6: Starting osmo-msc 08:00:39.580230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26066): Launched 08:00:39.883367 run osmo-msc_10.42.42.6(pid=26067): Launched 08:00:40.055109 run osmo-stp_10.42.42.5(pid=26064): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26064)] 08:00:40.182280 run osmo-stp_10.42.42.5(pid=26064): stdout: | (launched: 2022-12-14_08:00:38.695654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:40.309474 run osmo-stp_10.42.42.5(pid=26064): stderr: | 20221214080038867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080038867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080038867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080038868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080038868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080038868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080038868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:40.434486 run osmo-stp_10.42.42.5(pid=26064): stdout: | (launched: 2022-12-14_08:00:38.695654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:40.553879 run osmo-stp_10.42.42.5(pid=26064): stderr: | 20221214080038867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080038867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080038867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080038868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080038868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080038868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080038868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:40.697816 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26064): Process ended prematurely: osmo-stp_10.42.42.5(pid=26064) [trial-2401↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26064)] [trial-2401↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 08:00:40.706248 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 08:00:40.732283 run osmo-hlr_10.42.42.2(pid=26061): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26061)] 08:00:40.779496 run osmo-hlr_10.42.42.2(pid=26061): stdout: | (launched: 2022-12-14_08:00:37.754410) 08:00:40.828582 run osmo-hlr_10.42.42.2(pid=26061): stderr: | 20221214080037929 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080037929 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080037929 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080037929 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080037929 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080037929 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080037984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080037994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080037994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080037994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:40.897118 run osmo-msc_10.42.42.6(pid=26067): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26067)] 08:00:40.944304 run osmo-msc_10.42.42.6(pid=26067): stdout: | (launched: 2022-12-14_08:00:39.826449) 08:00:40.993242 run osmo-msc_10.42.42.6(pid=26067): stderr: | 20221214080040101 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080040101 DLGLOBAL DEBUG validating counter group 0x7fd021e40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080040101 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080040101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080040101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080040102 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080040103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080040104 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080040104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080040104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:00:41.042198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26060): Terminating (SIGTERM) 08:00:41.081864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26063): Terminating (SIGTERM) 08:00:41.121358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26066): Terminating (SIGTERM) 08:00:41.161733 --- ParallelTerminationStrategy: PID 26060 died... 08:00:41.180780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26060): Terminated: ok {rc=0} 08:00:41.224704 --- ParallelTerminationStrategy: PID 26063 died... 08:00:41.243383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26063): Terminated: ok {rc=0} 08:00:41.287220 --- ParallelTerminationStrategy: PID 26066 died... 08:00:41.305796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26066): Terminated: ok {rc=0} 08:00:41.392073 bus /sierra_3: Setting Powered False 08:00:42.494179 bus /sierra_3: Setting Powered False 08:00:43.612853 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 08:00:44.700041 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:44.711716 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 08:00:44.752807 tst emergency_preemptive_call.py: using LAC 39521 08:00:44.873812 tst emergency_preemptive_call.py: using RAC 251 08:00:44.990766 tst emergency_preemptive_call.py: using CellId 39521 08:00:45.114343 tst emergency_preemptive_call.py: using BVCI 39522 08:00:45.223842 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:45.234927 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:45.245781 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:45.256430 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:45.267250 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 08:00:45.278162 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:00:45.395466 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:00:45.516069 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:00:45.636195 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:00:45.753888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:46.289765 run create_hlr_db(pid=26069): Launched 08:00:46.447605 bus /sierra_2: Setting Powered False 08:00:47.511493 run create_hlr_db(pid=26069): Terminated: ok {rc=0} 08:00:47.964136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26071): Launched 08:00:48.291755 run osmo-hlr_10.42.42.2(pid=26072): Launched 08:00:48.418324 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:48.979659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26074): Launched 08:00:49.306624 run osmo-stp_10.42.42.5(pid=26075): Launched 08:00:49.455478 tst emergency_preemptive_call.py: using MSISDN 8575 08:00:49.623018 run osmo-msc_10.42.42.6: Starting osmo-msc 08:00:50.208196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26077): Launched 08:00:50.537038 run osmo-msc_10.42.42.6(pid=26078): Launched 08:00:50.720116 run osmo-stp_10.42.42.5(pid=26075): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26075)] 08:00:50.857246 run osmo-stp_10.42.42.5(pid=26075): stdout: | (launched: 2022-12-14_08:00:49.246080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:50.995132 run osmo-stp_10.42.42.5(pid=26075): stderr: | 20221214080049441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080049441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080049441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080049442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080049442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080049442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080049442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:51.132291 run osmo-stp_10.42.42.5(pid=26075): stdout: | (launched: 2022-12-14_08:00:49.246080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:51.261731 run osmo-stp_10.42.42.5(pid=26075): stderr: | 20221214080049441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080049441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080049441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080049442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080049442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080049442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080049442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:51.417005 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26075): Process ended prematurely: osmo-stp_10.42.42.5(pid=26075) [trial-2401↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26075)] [trial-2401↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 08:00:51.426208 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 08:00:51.454266 run osmo-hlr_10.42.42.2(pid=26072): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26072)] 08:00:51.505391 run osmo-hlr_10.42.42.2(pid=26072): stdout: | (launched: 2022-12-14_08:00:48.231571) 08:00:51.558219 run osmo-hlr_10.42.42.2(pid=26072): stderr: | 20221214080048430 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080048430 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080048430 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080048430 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080048430 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080048430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080048443 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080048451 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080048451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080048451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:51.631511 run osmo-msc_10.42.42.6(pid=26078): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26078)] 08:00:51.681654 run osmo-msc_10.42.42.6(pid=26078): stdout: | (launched: 2022-12-14_08:00:50.476253) 08:00:51.734197 run osmo-msc_10.42.42.6(pid=26078): stderr: | 20221214080050801 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080050801 DLGLOBAL DEBUG validating counter group 0x7fe245c04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080050801 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080050801 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080050802 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080050802 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080050803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080050804 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080050804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080050804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:00:51.786874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26071): Terminating (SIGTERM) 08:00:51.829054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26074): Terminating (SIGTERM) 08:00:51.871576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26077): Terminating (SIGTERM) 08:00:51.914704 --- ParallelTerminationStrategy: PID 26071 died... 08:00:51.935476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26071): Terminated: ok {rc=0} 08:00:51.985399 --- ParallelTerminationStrategy: PID 26074 died... 08:00:52.004904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26074): Terminated: ok {rc=0} 08:00:52.052493 --- ParallelTerminationStrategy: PID 26077 died... 08:00:52.073216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26077): Terminated: ok {rc=0} 08:00:52.163159 bus /sierra_9: Setting Powered False 08:00:53.262657 bus /sierra_9: Setting Powered False 08:00:54.379692 bus /sierra_8: Setting Powered False 08:00:55.478864 bus /sierra_8: Setting Powered False 08:00:56.598080 bus /sierra_3: Setting Powered False 08:00:57.696936 bus /sierra_3: Setting Powered False 08:00:58.812322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-1900 --------------------------------------------------------------------- 08:01:00.087626 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:01:00.094356 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 08:01:00.118239 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 08:01:00.156432 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 08:01:00.241700 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 08:01:00.265320 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 08:01:00.303358 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 08:01:00.906616 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 08:01:00.960862 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:00.972105 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 08:01:01.013093 tst cs_paging_gprs_active.py: using LAC 39522 08:01:01.160422 tst cs_paging_gprs_active.py: using RAC 252 08:01:01.282263 tst cs_paging_gprs_active.py: using CellId 39522 08:01:01.407293 tst cs_paging_gprs_active.py: using BVCI 39523 08:01:01.523062 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:01.534519 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:01.545850 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:01.556892 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:01.569076 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:01.580486 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:01.592268 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:01.604365 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:01.616341 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:01:01.736332 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:01:01.867885 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:01:02.082360 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:02.398319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26085): Launched 08:01:02.671636 run iperf3-srv_10.42.42.10(pid=26086): Launched 08:01:02.789771 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:01:02.997784 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:03.309721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26087): Launched 08:01:03.581895 run iperf3-srv_10.42.42.10(pid=26088): Launched 08:01:03.699410 tst cs_paging_gprs_active.py:38: start network... 08:01:03.908583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:04.391629 run create_hlr_db(pid=26089): Launched 08:01:04.523165 bus /sierra_2: Setting Powered False 08:01:05.588517 run create_hlr_db(pid=26089): Terminated: ok {rc=0} 08:01:06.030799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26091): Launched 08:01:06.345766 run osmo-hlr_10.42.42.2(pid=26092): Launched 08:01:06.464342 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:06.999170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26094): Launched 08:01:07.310921 run osmo-stp_10.42.42.5(pid=26095): Launched 08:01:07.431317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:07.966526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26097): Launched 08:01:08.085458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:08.349104 run patchelf(pid=26098): Launched 08:01:08.523528 run osmo-stp_10.42.42.5(pid=26095): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26095)] 08:01:08.654523 run osmo-stp_10.42.42.5(pid=26095): stdout: | (launched: 2022-12-14_08:01:07.252910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:08.787115 run osmo-stp_10.42.42.5(pid=26095): stderr: | 20221214080107425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080107425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080107425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080107425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080107428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080107428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080107428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:08.919449 run osmo-stp_10.42.42.5(pid=26095): stdout: | (launched: 2022-12-14_08:01:07.252910) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:09.045429 run osmo-stp_10.42.42.5(pid=26095): stderr: | 20221214080107425 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080107425 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080107425 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080107425 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080107428 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080107428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080107428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:09.195007 run patchelf(pid=26098): Terminating (SIGINT) 08:01:09.370334 run patchelf(pid=26098): Terminated: ok {rc=0} 08:01:09.496321 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26095): Process ended prematurely: osmo-stp_10.42.42.5(pid=26095) [trial-2401↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26095)] [trial-2401↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 08:01:09.505942 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:01:09.533225 run osmo-hlr_10.42.42.2(pid=26092): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26092)] 08:01:09.580852 run osmo-hlr_10.42.42.2(pid=26092): stdout: | (launched: 2022-12-14_08:01:06.285985) 08:01:09.630240 run osmo-hlr_10.42.42.2(pid=26092): stderr: | 20221214080106462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080106462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080106462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080106462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080106462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080106462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080106474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080106482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080106483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080106483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:09.679965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26085): Terminating (SIGTERM) 08:01:09.719905 run iperf3-srv_10.42.42.10(pid=26086): Terminating (SIGTERM) 08:01:09.759582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26087): Terminating (SIGTERM) 08:01:09.799395 run iperf3-srv_10.42.42.10(pid=26088): Terminating (SIGTERM) 08:01:09.839159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26091): Terminating (SIGTERM) 08:01:09.878992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26094): Terminating (SIGTERM) 08:01:09.918746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26097): Terminating (SIGTERM) 08:01:09.958750 --- ParallelTerminationStrategy: PID 26085 died... 08:01:09.977772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26085): Terminated: ok {rc=0} 08:01:10.021457 --- ParallelTerminationStrategy: PID 26086 died... 08:01:10.039723 run iperf3-srv_10.42.42.10(pid=26086): Terminated {rc=256} 08:01:10.083274 --- ParallelTerminationStrategy: PID 26087 died... 08:01:10.101783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26087): Terminated: ok {rc=0} 08:01:10.145228 --- ParallelTerminationStrategy: PID 26088 died... 08:01:10.163614 run iperf3-srv_10.42.42.10(pid=26088): Terminated {rc=256} 08:01:10.207137 --- ParallelTerminationStrategy: PID 26091 died... 08:01:10.225774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26091): Terminated: ok {rc=0} 08:01:10.269364 --- ParallelTerminationStrategy: PID 26094 died... 08:01:10.287950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26094): Terminated: ok {rc=0} 08:01:10.331454 --- ParallelTerminationStrategy: PID 26097 died... 08:01:10.350122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26097): Terminated: ok {rc=0} 08:01:10.435736 bus /gobi_0: Setting Powered False 08:01:11.536393 bus /gobi_0: Setting Powered False 08:01:12.648147 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 08:01:13.798752 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:13.813047 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 08:01:13.852059 tst iperf3.py: using LAC 39523 08:01:13.973553 tst iperf3.py: using RAC 253 08:01:14.101885 tst iperf3.py: using CellId 39523 08:01:14.223111 tst iperf3.py: using BVCI 39524 08:01:14.336681 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:14.347713 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:14.358625 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:14.369422 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:14.380115 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:14.390646 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:14.401466 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:14.411972 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:14.422657 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:01:14.545644 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:01:14.769251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:15.102376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26099): Launched 08:01:15.395376 run iperf3-srv_10.42.42.10(pid=26100): Launched 08:01:15.519774 tst iperf3.py:8: start network... 08:01:15.743424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:16.277976 run create_hlr_db(pid=26101): Launched 08:01:16.444058 bus /gobi_6: Setting Powered False 08:01:17.509734 run create_hlr_db(pid=26101): Terminated: ok {rc=0} 08:01:17.952785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26103): Launched 08:01:18.263387 run osmo-hlr_10.42.42.2(pid=26104): Launched 08:01:18.380683 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:18.910881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26106): Launched 08:01:19.220802 run osmo-stp_10.42.42.5(pid=26107): Launched 08:01:19.337700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:19.870557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26109): Launched 08:01:19.990493 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:20.251525 run patchelf(pid=26110): Launched 08:01:20.424076 run osmo-stp_10.42.42.5(pid=26107): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26107)] 08:01:20.553995 run osmo-stp_10.42.42.5(pid=26107): stdout: | (launched: 2022-12-14_08:01:19.163452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:20.685602 run osmo-stp_10.42.42.5(pid=26107): stderr: | 20221214080119336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080119336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080119337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080119337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080119338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080119338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080119338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:20.817223 run osmo-stp_10.42.42.5(pid=26107): stdout: | (launched: 2022-12-14_08:01:19.163452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:20.944003 run osmo-stp_10.42.42.5(pid=26107): stderr: | 20221214080119336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080119336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080119337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080119337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080119338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080119338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080119338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:21.092518 run patchelf(pid=26110): Terminating (SIGINT) 08:01:21.267411 run patchelf(pid=26110): Terminated: ok {rc=0} 08:01:21.393394 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26107): Process ended prematurely: osmo-stp_10.42.42.5(pid=26107) [trial-2401↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26107)] [trial-2401↪gprs:nanobts+band-1900↪iperf3.py:8] 08:01:21.403122 tst iperf3.py:8: Test FAILED (7.6 sec) 08:01:21.430587 run osmo-hlr_10.42.42.2(pid=26104): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26104)] 08:01:21.477972 run osmo-hlr_10.42.42.2(pid=26104): stdout: | (launched: 2022-12-14_08:01:18.205748) 08:01:21.527028 run osmo-hlr_10.42.42.2(pid=26104): stderr: | 20221214080118383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080118383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080118383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080118383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080118384 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080118384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080118396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080118408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080118408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080118408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:21.576551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26099): Terminating (SIGTERM) 08:01:21.616411 run iperf3-srv_10.42.42.10(pid=26100): Terminating (SIGTERM) 08:01:21.655830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26103): Terminating (SIGTERM) 08:01:21.695438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26106): Terminating (SIGTERM) 08:01:21.734833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26109): Terminating (SIGTERM) 08:01:21.774715 --- ParallelTerminationStrategy: PID 26099 died... 08:01:21.793933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26099): Terminated: ok {rc=0} 08:01:21.837860 --- ParallelTerminationStrategy: PID 26100 died... 08:01:21.856396 run iperf3-srv_10.42.42.10(pid=26100): Terminated {rc=256} 08:01:21.899954 --- ParallelTerminationStrategy: PID 26103 died... 08:01:21.918679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26103): Terminated: ok {rc=0} 08:01:21.962494 --- ParallelTerminationStrategy: PID 26106 died... 08:01:21.981302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26106): Terminated: ok {rc=0} 08:01:22.024918 --- ParallelTerminationStrategy: PID 26109 died... 08:01:22.043623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26109): Terminated: ok {rc=0} 08:01:22.129407 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 08:01:23.276385 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:23.287972 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 08:01:23.327405 tst iperf3m4.py: using LAC 39524 08:01:23.448906 tst iperf3m4.py: using RAC 254 08:01:23.572220 tst iperf3m4.py: using CellId 39524 08:01:23.700179 tst iperf3m4.py: using BVCI 39525 08:01:23.813527 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:23.824292 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:23.835033 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:23.845644 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:23.856433 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:23.867220 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:23.878089 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:23.888695 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:23.899665 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:01:24.017845 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:01:24.142637 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:01:24.264867 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:01:24.382399 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:01:24.590445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:24.903418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26111): Launched 08:01:25.177119 run iperf3-srv_10.42.42.10(pid=26112): Launched 08:01:25.295360 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:01:25.501832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:25.812557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26113): Launched 08:01:26.085097 run iperf3-srv_10.42.42.10(pid=26114): Launched 08:01:26.200505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:01:26.406685 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:26.717243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26115): Launched 08:01:26.990055 run iperf3-srv_10.42.42.10(pid=26116): Launched 08:01:27.105893 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:01:27.312191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:01:27.623197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26117): Launched 08:01:27.895551 run iperf3-srv_10.42.42.10(pid=26118): Launched 08:01:28.012792 tst iperf3m4.py:8: start network... 08:01:28.218243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:28.696544 run create_hlr_db(pid=26119): Launched 08:01:28.824529 bus /gobi_6: Setting Powered False 08:01:29.886491 run create_hlr_db(pid=26119): Terminated: ok {rc=0} 08:01:30.338171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26121): Launched 08:01:30.673540 run osmo-hlr_10.42.42.2(pid=26122): Launched 08:01:30.801698 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:31.499189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26124): Launched 08:01:31.834195 run osmo-stp_10.42.42.5(pid=26125): Launched 08:01:32.028243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:32.716481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26127): Launched 08:01:32.837775 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:33.099815 run patchelf(pid=26128): Launched 08:01:33.276938 run osmo-stp_10.42.42.5(pid=26125): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26125)] 08:01:33.408173 run osmo-stp_10.42.42.5(pid=26125): stdout: | (launched: 2022-12-14_08:01:31.770884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:33.540599 run osmo-stp_10.42.42.5(pid=26125): stderr: | 20221214080132110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080132110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080132110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080132111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080132121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080132121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080132121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:33.672780 run osmo-stp_10.42.42.5(pid=26125): stdout: | (launched: 2022-12-14_08:01:31.770884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:33.798637 run osmo-stp_10.42.42.5(pid=26125): stderr: | 20221214080132110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080132110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080132110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080132111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080132121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080132121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080132121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:33.947786 run patchelf(pid=26128): Terminating (SIGINT) 08:01:34.123410 run patchelf(pid=26128): Terminated: ok {rc=0} 08:01:34.249773 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26125): Process ended prematurely: osmo-stp_10.42.42.5(pid=26125) [trial-2401↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26125)] [trial-2401↪gprs:nanobts+band-1900↪iperf3m4.py:8] 08:01:34.259272 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:01:34.286626 run osmo-hlr_10.42.42.2(pid=26122): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26122)] 08:01:34.334058 run osmo-hlr_10.42.42.2(pid=26122): stdout: | (launched: 2022-12-14_08:01:30.611671) 08:01:34.383435 run osmo-hlr_10.42.42.2(pid=26122): stderr: | 20221214080130812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080130812 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080130812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080130812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080130812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080130812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080130824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080130844 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080130844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080130844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:34.433098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26111): Terminating (SIGTERM) 08:01:34.473276 run iperf3-srv_10.42.42.10(pid=26112): Terminating (SIGTERM) 08:01:34.513833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26113): Terminating (SIGTERM) 08:01:34.553691 run iperf3-srv_10.42.42.10(pid=26114): Terminating (SIGTERM) 08:01:34.593715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26115): Terminating (SIGTERM) 08:01:34.633683 run iperf3-srv_10.42.42.10(pid=26116): Terminating (SIGTERM) 08:01:34.673444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26117): Terminating (SIGTERM) 08:01:34.713297 run iperf3-srv_10.42.42.10(pid=26118): Terminating (SIGTERM) 08:01:34.752853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26121): Terminating (SIGTERM) 08:01:34.792695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26124): Terminating (SIGTERM) 08:01:34.832608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26127): Terminating (SIGTERM) 08:01:34.872668 --- ParallelTerminationStrategy: PID 26111 died... 08:01:34.892179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26111): Terminated: ok {rc=0} 08:01:34.936463 --- ParallelTerminationStrategy: PID 26112 died... 08:01:34.955441 run iperf3-srv_10.42.42.10(pid=26112): Terminated {rc=256} 08:01:34.999886 --- ParallelTerminationStrategy: PID 26113 died... 08:01:35.019395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26113): Terminated: ok {rc=0} 08:01:35.063531 --- ParallelTerminationStrategy: PID 26114 died... 08:01:35.082452 run iperf3-srv_10.42.42.10(pid=26114): Terminated {rc=256} 08:01:35.126288 --- ParallelTerminationStrategy: PID 26115 died... 08:01:35.145189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26115): Terminated: ok {rc=0} 08:01:35.189155 --- ParallelTerminationStrategy: PID 26116 died... 08:01:35.207876 run iperf3-srv_10.42.42.10(pid=26116): Terminated {rc=256} 08:01:35.251766 --- ParallelTerminationStrategy: PID 26117 died... 08:01:35.270771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26117): Terminated: ok {rc=0} 08:01:35.314841 --- ParallelTerminationStrategy: PID 26118 died... 08:01:35.333812 run iperf3-srv_10.42.42.10(pid=26118): Terminated {rc=256} 08:01:35.377724 --- ParallelTerminationStrategy: PID 26121 died... 08:01:35.396470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26121): Terminated: ok {rc=0} 08:01:35.440818 --- ParallelTerminationStrategy: PID 26124 died... 08:01:35.460093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26124): Terminated: ok {rc=0} 08:01:35.504051 --- ParallelTerminationStrategy: PID 26127 died... 08:01:35.523046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26127): Terminated: ok {rc=0} 08:01:35.608700 bus /gobi_4: Setting Powered False 08:01:36.709509 bus /gobi_4: Setting Powered False 08:01:37.826370 bus /gobi_1: Setting Powered False 08:01:38.925317 bus /gobi_1: Setting Powered False 08:01:40.042474 bus /gobi_0: Setting Powered False 08:01:41.142396 bus /gobi_0: Setting Powered False 08:01:42.259563 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 08:01:43.361857 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:43.374349 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 08:01:43.416439 tst ping.py: using LAC 39525 08:01:43.545073 tst ping.py: using RAC 255 08:01:43.672380 tst ping.py: using CellId 39525 08:01:43.801999 tst ping.py: using BVCI 39526 08:01:43.921167 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:43.932516 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:43.943731 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:43.954867 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:43.966350 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:43.977804 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:43.989372 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:44.000789 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:01:44.121908 tst ping.py:19: start network... 08:01:44.341210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:44.843087 run create_hlr_db(pid=26129): Launched 08:01:44.966777 bus /gobi_6: Setting Powered False 08:01:46.029383 run create_hlr_db(pid=26129): Terminated: ok {rc=0} 08:01:46.512812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26131): Launched 08:01:46.837687 run osmo-hlr_10.42.42.2(pid=26132): Launched 08:01:47.048593 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:47.633809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26134): Launched 08:01:47.942388 run osmo-stp_10.42.42.5(pid=26135): Launched 08:01:48.059656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:48.583586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26137): Launched 08:01:48.701210 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:48.957012 run patchelf(pid=26138): Launched 08:01:49.126707 run osmo-stp_10.42.42.5(pid=26135): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26135)] 08:01:49.254806 run osmo-stp_10.42.42.5(pid=26135): stdout: | (launched: 2022-12-14_08:01:47.885277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:49.384606 run osmo-stp_10.42.42.5(pid=26135): stderr: | 20221214080148058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080148058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080148058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080148058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080148059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080148059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080148059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:49.514265 run osmo-stp_10.42.42.5(pid=26135): stdout: | (launched: 2022-12-14_08:01:47.885277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:49.637513 run osmo-stp_10.42.42.5(pid=26135): stderr: | 20221214080148058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080148058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080148058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080148058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080148059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080148059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080148059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:49.783152 run patchelf(pid=26138): Terminating (SIGINT) 08:01:49.954231 run patchelf(pid=26138): Terminated: ok {rc=0} 08:01:50.077605 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26135): Process ended prematurely: osmo-stp_10.42.42.5(pid=26135) [trial-2401↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26135)] [trial-2401↪gprs:nanobts+band-1900↪ping.py:22] 08:01:50.086626 tst ping.py:22: Test FAILED (6.7 sec) 08:01:50.113504 run osmo-hlr_10.42.42.2(pid=26132): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26132)] 08:01:50.160896 run osmo-hlr_10.42.42.2(pid=26132): stdout: | (launched: 2022-12-14_08:01:46.778425) 08:01:50.209959 run osmo-hlr_10.42.42.2(pid=26132): stderr: | 20221214080147160 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080147161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080147161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080147161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080147161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080147161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080147184 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080147207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080147207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080147207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:50.259225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26131): Terminating (SIGTERM) 08:01:50.299061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26134): Terminating (SIGTERM) 08:01:50.338699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26137): Terminating (SIGTERM) 08:01:50.378889 --- ParallelTerminationStrategy: PID 26131 died... 08:01:50.398370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26131): Terminated: ok {rc=0} 08:01:50.442426 --- ParallelTerminationStrategy: PID 26134 died... 08:01:50.461291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26134): Terminated: ok {rc=0} 08:01:50.505348 --- ParallelTerminationStrategy: PID 26137 died... 08:01:50.524168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26137): Terminated: ok {rc=0} 08:01:50.610954 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 08:01:51.702103 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:51.714593 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 08:01:51.757543 tst ping_idle_ping.py: using LAC 39526 08:01:51.887101 tst ping_idle_ping.py: using RAC 1 08:01:52.016678 tst ping_idle_ping.py: using CellId 39526 08:01:52.145127 tst ping_idle_ping.py: using BVCI 39527 08:01:52.265315 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:52.276601 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:52.287843 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:52.298991 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:52.310915 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:52.323124 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:52.335209 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 08:01:52.347315 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 08:01:52.472185 tst ping_idle_ping.py:24: start network... 08:01:52.676875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:53.151478 run create_hlr_db(pid=26139): Launched 08:01:53.279767 bus /gobi_6: Setting Powered False 08:01:54.341638 run create_hlr_db(pid=26139): Terminated: ok {rc=0} 08:01:54.767896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26141): Launched 08:01:55.076153 run osmo-hlr_10.42.42.2(pid=26142): Launched 08:01:55.194180 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:55.716857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26144): Launched 08:01:56.023538 run osmo-stp_10.42.42.5(pid=26145): Launched 08:01:56.141872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:01:56.667792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26148): Launched 08:01:56.786705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:01:57.044378 run patchelf(pid=26149): Launched 08:01:57.216536 run osmo-stp_10.42.42.5(pid=26145): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26145)] 08:01:57.345254 run osmo-stp_10.42.42.5(pid=26145): stdout: | (launched: 2022-12-14_08:01:55.966645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:57.475235 run osmo-stp_10.42.42.5(pid=26145): stderr: | 20221214080156139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080156139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080156139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080156140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080156140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080156140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080156141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:57.605313 run osmo-stp_10.42.42.5(pid=26145): stdout: | (launched: 2022-12-14_08:01:55.966645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:57.728788 run osmo-stp_10.42.42.5(pid=26145): stderr: | 20221214080156139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080156139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080156139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080156140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080156140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080156140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080156141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:57.875536 run patchelf(pid=26149): Terminating (SIGINT) 08:01:58.047286 run patchelf(pid=26149): Terminated: ok {rc=0} 08:01:58.170801 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26145): Process ended prematurely: osmo-stp_10.42.42.5(pid=26145) [trial-2401↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26145)] [trial-2401↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 08:01:58.179648 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:01:58.206579 run osmo-hlr_10.42.42.2(pid=26142): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26142)] 08:01:58.254046 run osmo-hlr_10.42.42.2(pid=26142): stdout: | (launched: 2022-12-14_08:01:55.019012) 08:01:58.303129 run osmo-hlr_10.42.42.2(pid=26142): stderr: | 20221214080155197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080155197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080155197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080155197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080155197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080155197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080155210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080155218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080155219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080155219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:58.352527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26141): Terminating (SIGTERM) 08:01:58.392509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26144): Terminating (SIGTERM) 08:01:58.432177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26148): Terminating (SIGTERM) 08:01:58.472415 --- ParallelTerminationStrategy: PID 26141 died... 08:01:58.491819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26141): Terminated: ok {rc=0} 08:01:58.535630 --- ParallelTerminationStrategy: PID 26144 died... 08:01:58.554397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26144): Terminated: ok {rc=0} 08:01:58.597893 --- ParallelTerminationStrategy: PID 26148 died... 08:01:58.616493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26148): Terminated: ok {rc=0} 08:01:58.701662 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 08:02:00.008220 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:02:00.015476 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:02:00.039666 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:02:00.082079 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:02:00.172501 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:02:00.197673 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:02:00.237416 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:02:00.833950 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:02:00.889317 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:00.901112 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:02:00.943583 tst cs_paging_gprs_active.py: using LAC 39527 08:02:01.080341 tst cs_paging_gprs_active.py: using RAC 2 08:02:01.246665 tst cs_paging_gprs_active.py: using CellId 39527 08:02:01.389244 tst cs_paging_gprs_active.py: using BVCI 39528 08:02:01.516851 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:01.529393 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:01.541479 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:01.553448 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:01.566695 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:01.579970 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:01.592784 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:01.605491 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:01.618334 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:02:01.774315 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:02:01.925805 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:02:02.158857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:02:02.495761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26153): Launched 08:02:02.788035 run iperf3-srv_10.42.42.10(pid=26154): Launched 08:02:02.915256 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:02:03.139744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:02:03.474712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26155): Launched 08:02:03.765681 run iperf3-srv_10.42.42.10(pid=26156): Launched 08:02:03.892637 tst cs_paging_gprs_active.py:38: start network... 08:02:04.117674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:04.634175 run create_hlr_db(pid=26157): Launched 08:02:04.762103 bus /gobi_6: Setting Powered False 08:02:05.826769 run create_hlr_db(pid=26157): Terminated: ok {rc=0} 08:02:06.268324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26159): Launched 08:02:06.594743 run osmo-hlr_10.42.42.2(pid=26160): Launched 08:02:06.724410 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:07.295899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26162): Launched 08:02:07.631411 run osmo-stp_10.42.42.5(pid=26163): Launched 08:02:07.757573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:02:08.329534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26165): Launched 08:02:08.459095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:02:08.740528 run patchelf(pid=26166): Launched 08:02:08.927469 run osmo-stp_10.42.42.5(pid=26163): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26163)] 08:02:09.067938 run osmo-stp_10.42.42.5(pid=26163): stdout: | (launched: 2022-12-14_08:02:07.569610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:09.209306 run osmo-stp_10.42.42.5(pid=26163): stderr: | 20221214080207765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080207765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080207766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080207766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080207766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080207766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080207766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:09.351281 run osmo-stp_10.42.42.5(pid=26163): stdout: | (launched: 2022-12-14_08:02:07.569610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:09.486925 run osmo-stp_10.42.42.5(pid=26163): stderr: | 20221214080207765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080207765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080207766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080207766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080207766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080207766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080207766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:09.647497 run patchelf(pid=26166): Terminating (SIGINT) 08:02:09.834389 run patchelf(pid=26166): Terminated: ok {rc=0} 08:02:09.969383 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26163): Process ended prematurely: osmo-stp_10.42.42.5(pid=26163) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26163)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:02:09.979792 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 08:02:10.008761 run osmo-hlr_10.42.42.2(pid=26160): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26160)] 08:02:10.059384 run osmo-hlr_10.42.42.2(pid=26160): stdout: | (launched: 2022-12-14_08:02:06.532785) 08:02:10.111787 run osmo-hlr_10.42.42.2(pid=26160): stderr: | 20221214080206733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080206733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080206733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080206733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080206733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080206733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080206745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080206753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080206754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080206754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:10.164439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26153): Terminating (SIGTERM) 08:02:10.206275 run iperf3-srv_10.42.42.10(pid=26154): Terminating (SIGTERM) 08:02:10.249205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26155): Terminating (SIGTERM) 08:02:10.291366 run iperf3-srv_10.42.42.10(pid=26156): Terminating (SIGTERM) 08:02:10.333769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26159): Terminating (SIGTERM) 08:02:10.376051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26162): Terminating (SIGTERM) 08:02:10.418333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26165): Terminating (SIGTERM) 08:02:10.460675 --- ParallelTerminationStrategy: PID 26153 died... 08:02:10.481307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26153): Terminated: ok {rc=0} 08:02:10.527904 --- ParallelTerminationStrategy: PID 26154 died... 08:02:10.547881 run iperf3-srv_10.42.42.10(pid=26154): Terminated {rc=256} 08:02:10.594043 --- ParallelTerminationStrategy: PID 26155 died... 08:02:10.614047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26155): Terminated: ok {rc=0} 08:02:10.660225 --- ParallelTerminationStrategy: PID 26156 died... 08:02:10.680117 run iperf3-srv_10.42.42.10(pid=26156): Terminated {rc=256} 08:02:10.726250 --- ParallelTerminationStrategy: PID 26159 died... 08:02:10.746228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26159): Terminated: ok {rc=0} 08:02:10.792703 --- ParallelTerminationStrategy: PID 26162 died... 08:02:10.812801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26162): Terminated: ok {rc=0} 08:02:10.859309 --- ParallelTerminationStrategy: PID 26165 died... 08:02:10.879430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26165): Terminated: ok {rc=0} 08:02:10.968826 bus /gobi_0: Setting Powered False 08:02:12.068493 bus /gobi_0: Setting Powered False 08:02:13.184182 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:02:14.327592 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:14.339339 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:02:14.383617 tst iperf3.py: using LAC 39528 08:02:14.506282 tst iperf3.py: using RAC 3 08:02:14.629182 tst iperf3.py: using CellId 39528 08:02:14.752158 tst iperf3.py: using BVCI 39529 08:02:14.865262 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:14.876247 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:14.887216 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:14.898070 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:14.908842 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:14.919645 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:14.930624 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:14.941379 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:14.952234 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:02:15.068696 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:02:15.276723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:02:15.599655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Launched 08:02:15.881735 run iperf3-srv_10.42.42.10(pid=26170): Launched 08:02:16.010132 tst iperf3.py:8: start network... 08:02:16.216624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:16.729867 run create_hlr_db(pid=26171): Launched 08:02:16.881965 bus /gobi_6: Setting Powered False 08:02:17.942041 run create_hlr_db(pid=26171): Terminated: ok {rc=0} 08:02:18.364463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26173): Launched 08:02:18.668051 run osmo-hlr_10.42.42.2(pid=26174): Launched 08:02:18.782643 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:19.320877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26176): Launched 08:02:19.626243 run osmo-stp_10.42.42.5(pid=26177): Launched 08:02:19.740437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:02:20.260350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26179): Launched 08:02:20.376774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:02:20.632309 run patchelf(pid=26180): Launched 08:02:20.801173 run osmo-stp_10.42.42.5(pid=26177): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26177)] 08:02:20.929049 run osmo-stp_10.42.42.5(pid=26177): stdout: | (launched: 2022-12-14_08:02:19.569299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:21.057956 run osmo-stp_10.42.42.5(pid=26177): stderr: | 20221214080219739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080219739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080219739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080219740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080219740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080219740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080219740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:21.187271 run osmo-stp_10.42.42.5(pid=26177): stdout: | (launched: 2022-12-14_08:02:19.569299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:21.310076 run osmo-stp_10.42.42.5(pid=26177): stderr: | 20221214080219739 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080219739 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080219739 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080219740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080219740 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080219740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080219740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:21.456722 run patchelf(pid=26180): Terminating (SIGINT) 08:02:21.628029 run patchelf(pid=26180): Terminated: ok {rc=0} 08:02:21.751288 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26177): Process ended prematurely: osmo-stp_10.42.42.5(pid=26177) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26177)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 08:02:21.760559 tst iperf3.py:8: Test FAILED (7.5 sec) 08:02:21.787697 run osmo-hlr_10.42.42.2(pid=26174): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26174)] 08:02:21.834622 run osmo-hlr_10.42.42.2(pid=26174): stdout: | (launched: 2022-12-14_08:02:18.611798) 08:02:21.884024 run osmo-hlr_10.42.42.2(pid=26174): stderr: | 20221214080218786 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080218786 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080218786 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080218786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080218786 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080218786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080218798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080218808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080218808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080218808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:21.933556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Terminating (SIGTERM) 08:02:21.972991 run iperf3-srv_10.42.42.10(pid=26170): Terminating (SIGTERM) 08:02:22.012194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26173): Terminating (SIGTERM) 08:02:22.051431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26176): Terminating (SIGTERM) 08:02:22.090471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26179): Terminating (SIGTERM) 08:02:22.130092 --- ParallelTerminationStrategy: PID 26169 died... 08:02:22.149037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26169): Terminated: ok {rc=0} 08:02:22.192748 --- ParallelTerminationStrategy: PID 26170 died... 08:02:22.211178 run iperf3-srv_10.42.42.10(pid=26170): Terminated {rc=256} 08:02:22.254183 --- ParallelTerminationStrategy: PID 26173 died... 08:02:22.272538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26173): Terminated: ok {rc=0} 08:02:22.315499 --- ParallelTerminationStrategy: PID 26176 died... 08:02:22.333832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26176): Terminated: ok {rc=0} 08:02:22.376783 --- ParallelTerminationStrategy: PID 26179 died... 08:02:22.396351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26179): Terminated: ok {rc=0} 08:02:22.478458 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:02:23.627747 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:23.639971 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:02:23.683483 tst iperf3m4.py: using LAC 39529 08:02:23.815469 tst iperf3m4.py: using RAC 4 08:02:23.942573 tst iperf3m4.py: using CellId 39529 08:02:24.068504 tst iperf3m4.py: using BVCI 39530 08:02:24.187019 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:24.198597 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:24.209847 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:24.220900 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:24.232396 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:24.243869 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:24.255605 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:24.267168 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:24.278854 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:02:24.400335 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:02:24.519326 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:02:24.639460 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:02:24.758286 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:02:24.977665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:02:25.305288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26181): Launched 08:02:25.590894 run iperf3-srv_10.42.42.10(pid=26182): Launched 08:02:25.718624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:02:25.935166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:02:26.258085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26183): Launched 08:02:26.538772 run iperf3-srv_10.42.42.10(pid=26184): Launched 08:02:26.659238 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:02:26.874697 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:02:27.196319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26185): Launched 08:02:27.477546 run iperf3-srv_10.42.42.10(pid=26186): Launched 08:02:27.599445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:02:27.816386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:02:28.139077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26187): Launched 08:02:28.419781 run iperf3-srv_10.42.42.10(pid=26188): Launched 08:02:28.540243 tst iperf3m4.py:8: start network... 08:02:28.755921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:29.252510 run create_hlr_db(pid=26189): Launched 08:02:29.374858 bus /gobi_6: Setting Powered False 08:02:30.438223 run create_hlr_db(pid=26189): Terminated: ok {rc=0} 08:02:30.900315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26191): Launched 08:02:31.266609 run osmo-hlr_10.42.42.2(pid=26192): Launched 08:02:31.533336 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:32.170752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26194): Launched 08:02:32.476413 run osmo-stp_10.42.42.5(pid=26195): Launched 08:02:32.590403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:02:33.105988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26197): Launched 08:02:33.220086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:02:33.472692 run patchelf(pid=26198): Launched 08:02:33.639800 run osmo-stp_10.42.42.5(pid=26195): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26195)] 08:02:33.765544 run osmo-stp_10.42.42.5(pid=26195): stdout: | (launched: 2022-12-14_08:02:32.420675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:33.892920 run osmo-stp_10.42.42.5(pid=26195): stderr: | 20221214080232590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080232590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080232590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080232591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080232591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080232591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080232591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:34.021245 run osmo-stp_10.42.42.5(pid=26195): stdout: | (launched: 2022-12-14_08:02:32.420675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:34.142889 run osmo-stp_10.42.42.5(pid=26195): stderr: | 20221214080232590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080232590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080232590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080232591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080232591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080232591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080232591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:34.286454 run patchelf(pid=26198): Terminating (SIGINT) 08:02:34.455436 run patchelf(pid=26198): Terminated: ok {rc=0} 08:02:34.577094 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26195): Process ended prematurely: osmo-stp_10.42.42.5(pid=26195) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26195)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 08:02:34.586278 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:02:34.613215 run osmo-hlr_10.42.42.2(pid=26192): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26192)] 08:02:34.660070 run osmo-hlr_10.42.42.2(pid=26192): stdout: | (launched: 2022-12-14_08:02:31.198993) 08:02:34.708437 run osmo-hlr_10.42.42.2(pid=26192): stderr: | 20221214080231450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080231450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080231450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080231450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080231450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080231450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080231467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080231483 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080231483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080231483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:34.757315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26181): Terminating (SIGTERM) 08:02:34.796508 run iperf3-srv_10.42.42.10(pid=26182): Terminating (SIGTERM) 08:02:34.835656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26183): Terminating (SIGTERM) 08:02:34.874587 run iperf3-srv_10.42.42.10(pid=26184): Terminating (SIGTERM) 08:02:34.913444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26185): Terminating (SIGTERM) 08:02:34.952369 run iperf3-srv_10.42.42.10(pid=26186): Terminating (SIGTERM) 08:02:34.991099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26187): Terminating (SIGTERM) 08:02:35.030010 run iperf3-srv_10.42.42.10(pid=26188): Terminating (SIGTERM) 08:02:35.068802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26191): Terminating (SIGTERM) 08:02:35.107657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26194): Terminating (SIGTERM) 08:02:35.146499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26197): Terminating (SIGTERM) 08:02:35.185788 --- ParallelTerminationStrategy: PID 26181 died... 08:02:35.204500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26181): Terminated: ok {rc=0} 08:02:35.247821 --- ParallelTerminationStrategy: PID 26182 died... 08:02:35.266088 run iperf3-srv_10.42.42.10(pid=26182): Terminated {rc=256} 08:02:35.308895 --- ParallelTerminationStrategy: PID 26183 died... 08:02:35.327679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26183): Terminated: ok {rc=0} 08:02:35.370560 --- ParallelTerminationStrategy: PID 26184 died... 08:02:35.388672 run iperf3-srv_10.42.42.10(pid=26184): Terminated {rc=256} 08:02:35.431611 --- ParallelTerminationStrategy: PID 26185 died... 08:02:35.449883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26185): Terminated: ok {rc=0} 08:02:35.493237 --- ParallelTerminationStrategy: PID 26186 died... 08:02:35.511364 run iperf3-srv_10.42.42.10(pid=26186): Terminated {rc=256} 08:02:35.554549 --- ParallelTerminationStrategy: PID 26187 died... 08:02:35.572995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26187): Terminated: ok {rc=0} 08:02:35.615998 --- ParallelTerminationStrategy: PID 26188 died... 08:02:35.634160 run iperf3-srv_10.42.42.10(pid=26188): Terminated {rc=256} 08:02:35.677153 --- ParallelTerminationStrategy: PID 26191 died... 08:02:35.695419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26191): Terminated: ok {rc=0} 08:02:35.738505 --- ParallelTerminationStrategy: PID 26194 died... 08:02:35.756646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26194): Terminated: ok {rc=0} 08:02:35.799690 --- ParallelTerminationStrategy: PID 26197 died... 08:02:35.818537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26197): Terminated: ok {rc=0} 08:02:35.902988 bus /gobi_4: Setting Powered False 08:02:37.001369 bus /gobi_4: Setting Powered False 08:02:38.114728 bus /gobi_1: Setting Powered False 08:02:39.211711 bus /gobi_1: Setting Powered False 08:02:40.325044 bus /gobi_0: Setting Powered False 08:02:41.422025 bus /gobi_0: Setting Powered False 08:02:42.538086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 08:02:43.639530 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:43.651343 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:02:43.693464 tst ping.py: using LAC 39530 08:02:43.816809 tst ping.py: using RAC 5 08:02:43.940552 tst ping.py: using CellId 39530 08:02:44.063189 tst ping.py: using BVCI 39531 08:02:44.177113 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:44.188398 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:44.199622 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:44.211095 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:44.222458 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:44.233822 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:44.245465 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:44.256641 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:02:44.375476 tst ping.py:19: start network... 08:02:44.587521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:45.074056 run create_hlr_db(pid=26200): Launched 08:02:45.193570 bus /gobi_6: Setting Powered False 08:02:46.258932 run create_hlr_db(pid=26200): Terminated: ok {rc=0} 08:02:46.714468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26202): Launched 08:02:47.051680 run osmo-hlr_10.42.42.2(pid=26203): Launched 08:02:47.226794 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:47.774684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26206): Launched 08:02:48.090047 run osmo-stp_10.42.42.5(pid=26207): Launched 08:02:48.209671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:02:48.751527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26209): Launched 08:02:48.872380 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:02:49.138246 run patchelf(pid=26210): Launched 08:02:49.313218 run osmo-stp_10.42.42.5(pid=26207): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26207)] 08:02:49.447631 run osmo-stp_10.42.42.5(pid=26207): stdout: | (launched: 2022-12-14_08:02:48.032031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:49.583427 run osmo-stp_10.42.42.5(pid=26207): stderr: | 20221214080248219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080248219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080248220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080248220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080248221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080248221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080248221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:49.719028 run osmo-stp_10.42.42.5(pid=26207): stdout: | (launched: 2022-12-14_08:02:48.032031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:49.847892 run osmo-stp_10.42.42.5(pid=26207): stderr: | 20221214080248219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080248219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080248220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080248220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080248221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080248221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080248221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:50.000416 run patchelf(pid=26210): Terminating (SIGINT) 08:02:50.178290 run patchelf(pid=26210): Terminated: ok {rc=0} 08:02:50.306254 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26207): Process ended prematurely: osmo-stp_10.42.42.5(pid=26207) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26207)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 08:02:50.315776 tst ping.py:22: Test FAILED (6.7 sec) 08:02:50.343653 run osmo-hlr_10.42.42.2(pid=26203): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26203)] 08:02:50.394066 run osmo-hlr_10.42.42.2(pid=26203): stdout: | (launched: 2022-12-14_08:02:46.986319) 08:02:50.445722 run osmo-hlr_10.42.42.2(pid=26203): stderr: | 20221214080247257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080247257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080247258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080247258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080247258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080247258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080247269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080247278 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080247278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080247278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:50.497813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26202): Terminating (SIGTERM) 08:02:50.539641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26206): Terminating (SIGTERM) 08:02:50.581427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26209): Terminating (SIGTERM) 08:02:50.623621 --- ParallelTerminationStrategy: PID 26202 died... 08:02:50.643876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26202): Terminated: ok {rc=0} 08:02:50.690113 --- ParallelTerminationStrategy: PID 26206 died... 08:02:50.709855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26206): Terminated: ok {rc=0} 08:02:50.755900 --- ParallelTerminationStrategy: PID 26209 died... 08:02:50.775758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26209): Terminated: ok {rc=0} 08:02:50.863480 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:02:51.950232 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:51.962296 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:02:52.005706 tst ping_idle_ping.py: using LAC 39531 08:02:52.132209 tst ping_idle_ping.py: using RAC 6 08:02:52.256145 tst ping_idle_ping.py: using CellId 39531 08:02:52.382145 tst ping_idle_ping.py: using BVCI 39532 08:02:52.499311 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:52.510852 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:52.522130 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:52.533265 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:52.545358 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:52.557255 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:52.569311 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:02:52.581196 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:02:52.698855 tst ping_idle_ping.py:24: start network... 08:02:52.895485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:53.358266 run create_hlr_db(pid=26211): Launched 08:02:53.480026 bus /gobi_6: Setting Powered False 08:02:54.539908 run create_hlr_db(pid=26211): Terminated: ok {rc=0} 08:02:54.954289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26213): Launched 08:02:55.250334 run osmo-hlr_10.42.42.2(pid=26214): Launched 08:02:55.362976 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:55.869548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26216): Launched 08:02:56.166252 run osmo-stp_10.42.42.5(pid=26217): Launched 08:02:56.278345 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:02:56.789705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26219): Launched 08:02:56.901878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:02:57.148812 run patchelf(pid=26220): Launched 08:02:57.312544 run osmo-stp_10.42.42.5(pid=26217): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26217)] 08:02:57.436788 run osmo-stp_10.42.42.5(pid=26217): stdout: | (launched: 2022-12-14_08:02:56.111132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:57.562985 run osmo-stp_10.42.42.5(pid=26217): stderr: | 20221214080256278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080256278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080256279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080256279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080256280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080256280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080256280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:57.689481 run osmo-stp_10.42.42.5(pid=26217): stdout: | (launched: 2022-12-14_08:02:56.111132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:57.808929 run osmo-stp_10.42.42.5(pid=26217): stderr: | 20221214080256278 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080256278 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080256279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080256279 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080256280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080256280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080256280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:57.950543 run patchelf(pid=26220): Terminating (SIGINT) 08:02:58.116483 run patchelf(pid=26220): Terminated: ok {rc=0} 08:02:58.236827 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26217): Process ended prematurely: osmo-stp_10.42.42.5(pid=26217) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26217)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 08:02:58.245530 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 08:02:58.271805 run osmo-hlr_10.42.42.2(pid=26214): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26214)] 08:02:58.318213 run osmo-hlr_10.42.42.2(pid=26214): stdout: | (launched: 2022-12-14_08:02:55.195101) 08:02:58.366348 run osmo-hlr_10.42.42.2(pid=26214): stderr: | 20221214080255369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080255369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080255369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080255369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080255369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080255369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080255381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080255390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080255390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080255390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:58.415033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26213): Terminating (SIGTERM) 08:02:58.454266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26216): Terminating (SIGTERM) 08:02:58.493410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26219): Terminating (SIGTERM) 08:02:58.533297 --- ParallelTerminationStrategy: PID 26213 died... 08:02:58.552324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26213): Terminated: ok {rc=0} 08:02:58.595593 --- ParallelTerminationStrategy: PID 26216 died... 08:02:58.614018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26216): Terminated: ok {rc=0} 08:02:58.657141 --- ParallelTerminationStrategy: PID 26219 died... 08:02:58.675456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26219): Terminated: ok {rc=0} 08:02:58.759893 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:03:00.048177 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:03:00.055007 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:03:00.078079 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:03:00.115952 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:03:00.201450 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:03:00.224858 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:03:00.262723 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:03:00.874311 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:03:00.933372 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:00.944547 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:03:01.007505 tst cs_paging_gprs_active.py: using LAC 39532 08:03:01.160373 tst cs_paging_gprs_active.py: using RAC 7 08:03:01.279948 tst cs_paging_gprs_active.py: using CellId 39532 08:03:01.430250 tst cs_paging_gprs_active.py: using BVCI 39533 08:03:01.576184 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:01.593183 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:01.604448 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:01.618001 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:01.629377 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:01.640703 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:01.652269 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:01.663796 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:01.676038 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:03:01.813701 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:03:01.961275 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:03:02.209578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:02.536633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26243): Launched 08:03:02.816918 run iperf3-srv_10.42.42.10(pid=26245): Launched 08:03:02.937801 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:03:03.153404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:03.475957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26246): Launched 08:03:03.753797 run iperf3-srv_10.42.42.10(pid=26247): Launched 08:03:03.874714 tst cs_paging_gprs_active.py:38: start network... 08:03:04.091507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:04.590518 run create_hlr_db(pid=26248): Launched 08:03:04.712479 bus /gobi_6: Setting Powered False 08:03:05.775081 run create_hlr_db(pid=26248): Terminated: ok {rc=0} 08:03:06.202392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26251): Launched 08:03:06.503669 run osmo-hlr_10.42.42.2(pid=26252): Launched 08:03:06.617506 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:07.131007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26254): Launched 08:03:07.428859 run osmo-stp_10.42.42.5(pid=26255): Launched 08:03:07.542731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:03:08.058145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26257): Launched 08:03:08.172201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:03:08.424701 run patchelf(pid=26258): Launched 08:03:08.591956 run osmo-stp_10.42.42.5(pid=26255): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26255)] 08:03:08.718242 run osmo-stp_10.42.42.5(pid=26255): stdout: | (launched: 2022-12-14_08:03:07.373787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:08.846171 run osmo-stp_10.42.42.5(pid=26255): stderr: | 20221214080307541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080307541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080307541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080307542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080307542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080307542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080307543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:08.973634 run osmo-stp_10.42.42.5(pid=26255): stdout: | (launched: 2022-12-14_08:03:07.373787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:09.095597 run osmo-stp_10.42.42.5(pid=26255): stderr: | 20221214080307541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080307541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080307541 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080307542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080307542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080307542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080307543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:09.239945 run patchelf(pid=26258): Terminating (SIGINT) 08:03:09.409234 run patchelf(pid=26258): Terminated: ok {rc=0} 08:03:09.531394 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26255): Process ended prematurely: osmo-stp_10.42.42.5(pid=26255) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26255)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:03:09.540620 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:03:09.567497 run osmo-hlr_10.42.42.2(pid=26252): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26252)] 08:03:09.614210 run osmo-hlr_10.42.42.2(pid=26252): stdout: | (launched: 2022-12-14_08:03:06.447986) 08:03:09.662719 run osmo-hlr_10.42.42.2(pid=26252): stderr: | 20221214080306620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080306620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080306620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080306620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080306620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080306620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080306678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080306688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080306688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080306688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:09.711623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26243): Terminating (SIGTERM) 08:03:09.751683 run iperf3-srv_10.42.42.10(pid=26245): Terminating (SIGTERM) 08:03:09.791204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26246): Terminating (SIGTERM) 08:03:09.830619 run iperf3-srv_10.42.42.10(pid=26247): Terminating (SIGTERM) 08:03:09.869800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26251): Terminating (SIGTERM) 08:03:09.909243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26254): Terminating (SIGTERM) 08:03:09.948289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26257): Terminating (SIGTERM) 08:03:09.987848 --- ParallelTerminationStrategy: PID 26243 died... 08:03:10.006343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26243): Terminated: ok {rc=0} 08:03:10.049891 --- ParallelTerminationStrategy: PID 26245 died... 08:03:10.068228 run iperf3-srv_10.42.42.10(pid=26245): Terminated {rc=256} 08:03:10.111358 --- ParallelTerminationStrategy: PID 26246 died... 08:03:10.129758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26246): Terminated: ok {rc=0} 08:03:10.172933 --- ParallelTerminationStrategy: PID 26247 died... 08:03:10.191294 run iperf3-srv_10.42.42.10(pid=26247): Terminated {rc=256} 08:03:10.234786 --- ParallelTerminationStrategy: PID 26251 died... 08:03:10.253210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26251): Terminated: ok {rc=0} 08:03:10.296309 --- ParallelTerminationStrategy: PID 26254 died... 08:03:10.314789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26254): Terminated: ok {rc=0} 08:03:10.357851 --- ParallelTerminationStrategy: PID 26257 died... 08:03:10.376166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26257): Terminated: ok {rc=0} 08:03:10.460456 bus /gobi_0: Setting Powered False 08:03:11.559438 bus /gobi_0: Setting Powered False 08:03:12.674136 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:03:13.824261 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:13.836467 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:03:13.901426 tst iperf3.py: using LAC 39533 08:03:14.020758 tst iperf3.py: using RAC 8 08:03:14.139479 tst iperf3.py: using CellId 39533 08:03:14.257846 tst iperf3.py: using BVCI 39534 08:03:14.365514 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:14.376411 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:14.387161 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:14.397907 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:14.408631 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:14.419435 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:14.430269 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:14.440804 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:14.452199 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:03:14.570874 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:03:14.787466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:15.109381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26259): Launched 08:03:15.391923 run iperf3-srv_10.42.42.10(pid=26260): Launched 08:03:15.512828 tst iperf3.py:8: start network... 08:03:15.729236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:16.312668 run create_hlr_db(pid=26261): Launched 08:03:16.490729 bus /gobi_6: Setting Powered False 08:03:17.553785 run create_hlr_db(pid=26261): Terminated: ok {rc=0} 08:03:17.984877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26263): Launched 08:03:18.284531 run osmo-hlr_10.42.42.2(pid=26264): Launched 08:03:18.398212 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:18.909706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26266): Launched 08:03:19.208642 run osmo-stp_10.42.42.5(pid=26267): Launched 08:03:19.322347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:03:19.835376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26269): Launched 08:03:19.950161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:03:20.201818 run patchelf(pid=26270): Launched 08:03:20.369249 run osmo-stp_10.42.42.5(pid=26267): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26267)] 08:03:20.495138 run osmo-stp_10.42.42.5(pid=26267): stdout: | (launched: 2022-12-14_08:03:19.153282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:20.622926 run osmo-stp_10.42.42.5(pid=26267): stderr: | 20221214080319320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080319320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080319320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080319321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080319321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080319321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080319321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:20.750362 run osmo-stp_10.42.42.5(pid=26267): stdout: | (launched: 2022-12-14_08:03:19.153282) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:20.871911 run osmo-stp_10.42.42.5(pid=26267): stderr: | 20221214080319320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080319320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080319320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080319321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080319321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080319321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080319321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:21.015917 run patchelf(pid=26270): Terminating (SIGINT) 08:03:21.185744 run patchelf(pid=26270): Terminated: ok {rc=0} 08:03:21.307521 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26267): Process ended prematurely: osmo-stp_10.42.42.5(pid=26267) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26267)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 08:03:21.316890 tst iperf3.py:8: Test FAILED (7.5 sec) 08:03:21.343570 run osmo-hlr_10.42.42.2(pid=26264): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26264)] 08:03:21.390689 run osmo-hlr_10.42.42.2(pid=26264): stdout: | (launched: 2022-12-14_08:03:18.229436) 08:03:21.439205 run osmo-hlr_10.42.42.2(pid=26264): stderr: | 20221214080318399 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080318399 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080318399 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080318399 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080318399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080318399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080318412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080318421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080318421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080318421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:21.488043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26259): Terminating (SIGTERM) 08:03:21.527666 run iperf3-srv_10.42.42.10(pid=26260): Terminating (SIGTERM) 08:03:21.567096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26263): Terminating (SIGTERM) 08:03:21.606484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26266): Terminating (SIGTERM) 08:03:21.645752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26269): Terminating (SIGTERM) 08:03:21.685527 --- ParallelTerminationStrategy: PID 26259 died... 08:03:21.704691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26259): Terminated: ok {rc=0} 08:03:21.748337 --- ParallelTerminationStrategy: PID 26260 died... 08:03:21.767157 run iperf3-srv_10.42.42.10(pid=26260): Terminated {rc=256} 08:03:21.810647 --- ParallelTerminationStrategy: PID 26263 died... 08:03:21.829333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26263): Terminated: ok {rc=0} 08:03:21.873259 --- ParallelTerminationStrategy: PID 26266 died... 08:03:21.891817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26266): Terminated: ok {rc=0} 08:03:21.935360 --- ParallelTerminationStrategy: PID 26269 died... 08:03:21.954087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26269): Terminated: ok {rc=0} 08:03:22.039318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:03:23.184142 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:23.195914 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:03:23.256684 tst iperf3m4.py: using LAC 39534 08:03:23.375903 tst iperf3m4.py: using RAC 9 08:03:23.493534 tst iperf3m4.py: using CellId 39534 08:03:23.615046 tst iperf3m4.py: using BVCI 39535 08:03:23.723770 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:23.734763 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:23.745497 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:23.756053 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:23.766658 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:23.777908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:23.789375 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:23.800024 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:23.810955 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:03:23.934641 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:03:24.052737 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:03:24.170171 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:03:24.291191 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:03:24.507047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:24.827527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26271): Launched 08:03:25.106363 run iperf3-srv_10.42.42.10(pid=26272): Launched 08:03:25.226491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:03:25.441882 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:25.763251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26273): Launched 08:03:26.042007 run iperf3-srv_10.42.42.10(pid=26274): Launched 08:03:26.162115 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:03:26.377434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:26.698033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26275): Launched 08:03:26.977052 run iperf3-srv_10.42.42.10(pid=26276): Launched 08:03:27.097688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:03:27.312189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:27.634259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26277): Launched 08:03:27.913595 run iperf3-srv_10.42.42.10(pid=26278): Launched 08:03:28.034358 tst iperf3m4.py:8: start network... 08:03:28.250033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:28.746777 run create_hlr_db(pid=26279): Launched 08:03:28.868384 bus /gobi_6: Setting Powered False 08:03:29.932487 run create_hlr_db(pid=26279): Terminated: ok {rc=0} 08:03:30.359240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26281): Launched 08:03:30.658433 run osmo-hlr_10.42.42.2(pid=26282): Launched 08:03:30.771652 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:31.416751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26284): Launched 08:03:31.754406 run osmo-stp_10.42.42.5(pid=26285): Launched 08:03:32.008095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:03:32.653494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26287): Launched 08:03:32.777242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:03:33.048761 run patchelf(pid=26288): Launched 08:03:33.227249 run osmo-stp_10.42.42.5(pid=26285): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26285)] 08:03:33.362437 run osmo-stp_10.42.42.5(pid=26285): stdout: | (launched: 2022-12-14_08:03:31.689952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:33.500196 run osmo-stp_10.42.42.5(pid=26285): stderr: | 20221214080332008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080332008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080332009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080332009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080332010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080332010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080332010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:33.637425 run osmo-stp_10.42.42.5(pid=26285): stdout: | (launched: 2022-12-14_08:03:31.689952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:33.767796 run osmo-stp_10.42.42.5(pid=26285): stderr: | 20221214080332008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080332008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080332009 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080332009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080332010 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080332010 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080332010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:33.923048 run patchelf(pid=26288): Terminating (SIGINT) 08:03:34.104183 run patchelf(pid=26288): Terminated: ok {rc=0} 08:03:34.234765 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26285): Process ended prematurely: osmo-stp_10.42.42.5(pid=26285) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26285)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:03:34.244899 tst iperf3m4.py:8: Test FAILED (11.1 sec) 08:03:34.273706 run osmo-hlr_10.42.42.2(pid=26282): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26282)] 08:03:34.324133 run osmo-hlr_10.42.42.2(pid=26282): stdout: | (launched: 2022-12-14_08:03:30.602983) 08:03:34.376294 run osmo-hlr_10.42.42.2(pid=26282): stderr: | 20221214080330775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080330775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080330775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080330775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080330775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080330775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080330788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080330798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080330798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080330798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:34.428467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26271): Terminating (SIGTERM) 08:03:34.470395 run iperf3-srv_10.42.42.10(pid=26272): Terminating (SIGTERM) 08:03:34.512080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26273): Terminating (SIGTERM) 08:03:34.553813 run iperf3-srv_10.42.42.10(pid=26274): Terminating (SIGTERM) 08:03:34.595364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26275): Terminating (SIGTERM) 08:03:34.637517 run iperf3-srv_10.42.42.10(pid=26276): Terminating (SIGTERM) 08:03:34.679665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26277): Terminating (SIGTERM) 08:03:34.721890 run iperf3-srv_10.42.42.10(pid=26278): Terminating (SIGTERM) 08:03:34.763901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26281): Terminating (SIGTERM) 08:03:34.806056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26284): Terminating (SIGTERM) 08:03:34.848179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26287): Terminating (SIGTERM) 08:03:34.890316 --- ParallelTerminationStrategy: PID 26271 died... 08:03:34.910223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26271): Terminated: ok {rc=0} 08:03:34.956422 --- ParallelTerminationStrategy: PID 26272 died... 08:03:34.976171 run iperf3-srv_10.42.42.10(pid=26272): Terminated {rc=256} 08:03:35.021809 --- ParallelTerminationStrategy: PID 26273 died... 08:03:35.041422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26273): Terminated: ok {rc=0} 08:03:35.087196 --- ParallelTerminationStrategy: PID 26274 died... 08:03:35.106711 run iperf3-srv_10.42.42.10(pid=26274): Terminated {rc=256} 08:03:35.151936 --- ParallelTerminationStrategy: PID 26275 died... 08:03:35.171524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26275): Terminated: ok {rc=0} 08:03:35.217440 --- ParallelTerminationStrategy: PID 26276 died... 08:03:35.237015 run iperf3-srv_10.42.42.10(pid=26276): Terminated {rc=256} 08:03:35.282413 --- ParallelTerminationStrategy: PID 26277 died... 08:03:35.302109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26277): Terminated: ok {rc=0} 08:03:35.348139 --- ParallelTerminationStrategy: PID 26278 died... 08:03:35.367750 run iperf3-srv_10.42.42.10(pid=26278): Terminated {rc=256} 08:03:35.413422 --- ParallelTerminationStrategy: PID 26281 died... 08:03:35.433066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26281): Terminated: ok {rc=0} 08:03:35.478554 --- ParallelTerminationStrategy: PID 26284 died... 08:03:35.498249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26284): Terminated: ok {rc=0} 08:03:35.543768 --- ParallelTerminationStrategy: PID 26287 died... 08:03:35.563543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26287): Terminated: ok {rc=0} 08:03:35.650958 bus /gobi_4: Setting Powered False 08:03:36.749406 bus /gobi_4: Setting Powered False 08:03:37.864365 bus /gobi_1: Setting Powered False 08:03:38.960453 bus /gobi_1: Setting Powered False 08:03:40.075313 bus /gobi_0: Setting Powered False 08:03:41.172480 bus /gobi_0: Setting Powered False 08:03:42.292255 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:03:43.393512 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:43.405545 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:03:43.465048 tst ping.py: using LAC 39535 08:03:43.579214 tst ping.py: using RAC 10 08:03:43.694511 tst ping.py: using CellId 39535 08:03:43.809394 tst ping.py: using BVCI 39536 08:03:43.916793 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:43.927904 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:43.938778 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:43.949661 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:43.960326 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:43.971092 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:43.981972 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:43.992653 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:03:44.112366 tst ping.py:19: start network... 08:03:44.325941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:44.812330 run create_hlr_db(pid=26290): Launched 08:03:44.931857 bus /gobi_6: Setting Powered False 08:03:45.998678 run create_hlr_db(pid=26290): Terminated: ok {rc=0} 08:03:46.475197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26292): Launched 08:03:46.788516 run osmo-hlr_10.42.42.2(pid=26293): Launched 08:03:47.023004 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:47.603180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26295): Launched 08:03:47.896048 run osmo-stp_10.42.42.5(pid=26296): Launched 08:03:48.006378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:03:48.510910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26298): Launched 08:03:48.623048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:03:48.870287 run patchelf(pid=26299): Launched 08:03:49.033302 run osmo-stp_10.42.42.5(pid=26296): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26296)] 08:03:49.156904 run osmo-stp_10.42.42.5(pid=26296): stdout: | (launched: 2022-12-14_08:03:47.841988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:49.281899 run osmo-stp_10.42.42.5(pid=26296): stderr: | 20221214080348008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080348008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080348008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080348009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080348009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080348009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080348009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:49.407143 run osmo-stp_10.42.42.5(pid=26296): stdout: | (launched: 2022-12-14_08:03:47.841988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:49.526430 run osmo-stp_10.42.42.5(pid=26296): stderr: | 20221214080348008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080348008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080348008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080348009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080348009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080348009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080348009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:49.667357 run patchelf(pid=26299): Terminating (SIGINT) 08:03:49.832303 run patchelf(pid=26299): Terminated: ok {rc=0} 08:03:49.951074 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26296): Process ended prematurely: osmo-stp_10.42.42.5(pid=26296) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26296)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 08:03:49.959778 tst ping.py:22: Test FAILED (6.6 sec) 08:03:49.986128 run osmo-hlr_10.42.42.2(pid=26293): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26293)] 08:03:50.032731 run osmo-hlr_10.42.42.2(pid=26293): stdout: | (launched: 2022-12-14_08:03:46.726088) 08:03:50.081769 run osmo-hlr_10.42.42.2(pid=26293): stderr: | 20221214080347067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080347067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080347067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080347067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080347067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080347068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080347087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080347095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080347095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080347095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:50.130425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26292): Terminating (SIGTERM) 08:03:50.169397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26295): Terminating (SIGTERM) 08:03:50.208264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26298): Terminating (SIGTERM) 08:03:50.247714 --- ParallelTerminationStrategy: PID 26292 died... 08:03:50.266757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26292): Terminated: ok {rc=0} 08:03:50.310273 --- ParallelTerminationStrategy: PID 26295 died... 08:03:50.328727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26295): Terminated: ok {rc=0} 08:03:50.372024 --- ParallelTerminationStrategy: PID 26298 died... 08:03:50.390505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26298): Terminated: ok {rc=0} 08:03:50.475245 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:03:51.560694 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:51.572420 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:03:51.632830 tst ping_idle_ping.py: using LAC 39536 08:03:51.755071 tst ping_idle_ping.py: using RAC 11 08:03:51.870157 tst ping_idle_ping.py: using CellId 39536 08:03:51.985171 tst ping_idle_ping.py: using BVCI 39537 08:03:52.091410 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:52.102556 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:52.113389 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:52.124072 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:52.134754 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:52.145553 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:52.156350 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:03:52.167543 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:03:52.287948 tst ping_idle_ping.py:24: start network... 08:03:52.501028 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:52.990053 run create_hlr_db(pid=26300): Launched 08:03:53.110235 bus /gobi_6: Setting Powered False 08:03:54.173169 run create_hlr_db(pid=26300): Terminated: ok {rc=0} 08:03:54.596131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26302): Launched 08:03:54.892676 run osmo-hlr_10.42.42.2(pid=26303): Launched 08:03:55.004820 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:55.523641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26305): Launched 08:03:55.816187 run osmo-stp_10.42.42.5(pid=26306): Launched 08:03:55.927894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:03:56.434422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26309): Launched 08:03:56.546510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:03:56.794029 run patchelf(pid=26310): Launched 08:03:56.957470 run osmo-stp_10.42.42.5(pid=26306): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26306)] 08:03:57.081469 run osmo-stp_10.42.42.5(pid=26306): stdout: | (launched: 2022-12-14_08:03:55.762056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:57.206799 run osmo-stp_10.42.42.5(pid=26306): stderr: | 20221214080355928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080355929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080355929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080355929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080355930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080355930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080355930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:57.332143 run osmo-stp_10.42.42.5(pid=26306): stdout: | (launched: 2022-12-14_08:03:55.762056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:57.451354 run osmo-stp_10.42.42.5(pid=26306): stderr: | 20221214080355928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080355929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080355929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080355929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080355930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080355930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080355930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:57.592696 run patchelf(pid=26310): Terminating (SIGINT) 08:03:57.758562 run patchelf(pid=26310): Terminated: ok {rc=0} 08:03:57.877865 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26306): Process ended prematurely: osmo-stp_10.42.42.5(pid=26306) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26306)] [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:03:57.886469 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 08:03:57.912607 run osmo-hlr_10.42.42.2(pid=26303): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26303)] 08:03:57.960116 run osmo-hlr_10.42.42.2(pid=26303): stdout: | (launched: 2022-12-14_08:03:54.837992) 08:03:58.008614 run osmo-hlr_10.42.42.2(pid=26303): stderr: | 20221214080355009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080355009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080355009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080355009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080355009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080355009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080355022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080355033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080355033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080355033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:58.057552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26302): Terminating (SIGTERM) 08:03:58.096901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26305): Terminating (SIGTERM) 08:03:58.136728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26309): Terminating (SIGTERM) 08:03:58.176474 --- ParallelTerminationStrategy: PID 26302 died... 08:03:58.195533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26302): Terminated: ok {rc=0} 08:03:58.239157 --- ParallelTerminationStrategy: PID 26305 died... 08:03:58.257601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26305): Terminated: ok {rc=0} 08:03:58.300731 --- ParallelTerminationStrategy: PID 26309 died... 08:03:58.319287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26309): Terminated: ok {rc=0} 08:03:58.404202 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 08:03:59.693548 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:03:59.701351 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:03:59.724581 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:03:59.758650 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:03:59.811172 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:03:59.835472 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:03:59.870686 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:04:00.432452 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:04:00.438262 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:04:00.450272 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:04:00.512714 tst switch_tch_pdch.py: using LAC 39537 08:04:00.637382 tst switch_tch_pdch.py: using RAC 12 08:04:00.761362 tst switch_tch_pdch.py: using CellId 39537 08:04:00.899695 tst switch_tch_pdch.py: using BVCI 39538 08:04:01.012842 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:04:01.025826 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:04:01.038399 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:04:01.050951 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:04:01.064474 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:04:01.078055 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:04:01.091616 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:04:01.105371 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:04:01.245591 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:04:01.389888 tst switch_tch_pdch.py:51: start network... 08:04:01.646644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:02.158030 run create_hlr_db(pid=26314): Launched 08:04:02.304052 bus /gobi_6: Setting Powered False 08:04:03.367595 run create_hlr_db(pid=26314): Terminated: ok {rc=0} 08:04:03.813426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26316): Launched 08:04:04.134349 run osmo-hlr_10.42.42.2(pid=26317): Launched 08:04:04.255374 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:04.806366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26319): Launched 08:04:05.125573 run osmo-stp_10.42.42.5(pid=26320): Launched 08:04:05.247961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:04:05.802065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26322): Launched 08:04:05.924540 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:04:06.194048 run patchelf(pid=26323): Launched 08:04:06.372232 run osmo-stp_10.42.42.5(pid=26320): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26320)] 08:04:06.507836 run osmo-stp_10.42.42.5(pid=26320): stdout: | (launched: 2022-12-14_08:04:05.066697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:06.644389 run osmo-stp_10.42.42.5(pid=26320): stderr: | 20221214080405255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080405255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080405255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080405256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080405256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080405256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080405257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:06.781307 run osmo-stp_10.42.42.5(pid=26320): stdout: | (launched: 2022-12-14_08:04:05.066697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:06.911185 run osmo-stp_10.42.42.5(pid=26320): stderr: | 20221214080405255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080405255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080405255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080405256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080405256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080405256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080405257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:07.065399 run patchelf(pid=26323): Terminating (SIGINT) 08:04:07.245255 run patchelf(pid=26323): Terminated: ok {rc=0} 08:04:07.374974 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26320): Process ended prematurely: osmo-stp_10.42.42.5(pid=26320) [trial-2401↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26320)] [trial-2401↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:04:07.384418 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 08:04:07.412658 run osmo-hlr_10.42.42.2(pid=26317): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26317)] 08:04:07.462898 run osmo-hlr_10.42.42.2(pid=26317): stdout: | (launched: 2022-12-14_08:04:04.075207) 08:04:07.514423 run osmo-hlr_10.42.42.2(pid=26317): stderr: | 20221214080404272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080404272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080404272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080404272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080404272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080404272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080404284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080404292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080404292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080404292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:07.566267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26316): Terminating (SIGTERM) 08:04:07.607983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26319): Terminating (SIGTERM) 08:04:07.649585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26322): Terminating (SIGTERM) 08:04:07.691454 --- ParallelTerminationStrategy: PID 26316 died... 08:04:07.711688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26316): Terminated: ok {rc=0} 08:04:07.757730 --- ParallelTerminationStrategy: PID 26319 died... 08:04:07.777481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26319): Terminated: ok {rc=0} 08:04:07.823214 --- ParallelTerminationStrategy: PID 26322 died... 08:04:07.842844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26322): Terminated: ok {rc=0} 08:04:07.930501 bus /gobi_0: Setting Powered False 08:04:09.027846 bus /gobi_0: Setting Powered False 08:04:10.145327 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 sms:nanobts+band-900 --------------------------------------------------------------------- 08:04:11.386644 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:04:11.391486 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:04:11.423658 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 08:04:11.450230 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 08:04:11.505354 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:04:11.537176 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 08:04:11.563120 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 08:04:12.105823 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 08:04:12.110677 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:12.121413 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 08:04:12.166804 tst mo_mt_sms.py: using LAC 39538 08:04:12.295673 tst mo_mt_sms.py: using RAC 13 08:04:12.414943 tst mo_mt_sms.py: using CellId 39538 08:04:12.531294 tst mo_mt_sms.py: using BVCI 39539 08:04:12.638024 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:12.648675 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:12.659303 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:12.669960 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:12.680324 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:12.691334 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 08:04:12.811914 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 08:04:12.930511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:13.422775 run create_hlr_db(pid=26327): Launched 08:04:13.543785 bus /gobi_6: Setting Powered False 08:04:14.607379 run create_hlr_db(pid=26327): Terminated: ok {rc=0} 08:04:15.033333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26329): Launched 08:04:15.330871 run osmo-hlr_10.42.42.2(pid=26330): Launched 08:04:15.443126 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:15.989753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26332): Launched 08:04:16.307267 run osmo-stp_10.42.42.5(pid=26333): Launched 08:04:16.646850 run osmo-msc_10.42.42.6: Starting osmo-msc 08:04:17.237747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26335): Launched 08:04:17.546741 run osmo-msc_10.42.42.6(pid=26336): Launched 08:04:17.712864 run osmo-stp_10.42.42.5(pid=26333): ERR: Terminated: ERROR {rc=1} [trial-2401↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26333)] 08:04:17.838405 run osmo-stp_10.42.42.5(pid=26333): stdout: | (launched: 2022-12-14_08:04:16.243065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:17.963556 run osmo-stp_10.42.42.5(pid=26333): stderr: | 20221214080416461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080416462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080416463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080416464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080416465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080416465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080416466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:18.087038 run osmo-stp_10.42.42.5(pid=26333): stdout: | (launched: 2022-12-14_08:04:16.243065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:18.204645 run osmo-stp_10.42.42.5(pid=26333): stderr: | 20221214080416461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080416462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080416463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080416464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080416465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080416465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080416466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:18.347260 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26333): Process ended prematurely: osmo-stp_10.42.42.5(pid=26333) [trial-2401↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26333)] [trial-2401↪sms:nanobts+band-900↪mo_mt_sms.py:16] 08:04:18.355676 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 08:04:18.381642 run osmo-hlr_10.42.42.2(pid=26330): ERR: Terminated: ERROR {rc=237} [trial-2401↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26330)] 08:04:18.428892 run osmo-hlr_10.42.42.2(pid=26330): stdout: | (launched: 2022-12-14_08:04:15.275666) 08:04:18.478073 run osmo-hlr_10.42.42.2(pid=26330): stderr: | 20221214080415448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080415448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080415448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080415448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080415448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080415448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080415460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080415468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080415469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080415469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:18.546358 run osmo-msc_10.42.42.6(pid=26336): ERR: Terminated: ERROR {rc=2} [trial-2401↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26336)] 08:04:18.592924 run osmo-msc_10.42.42.6(pid=26336): stdout: | (launched: 2022-12-14_08:04:17.490729) 08:04:18.641388 run osmo-msc_10.42.42.6(pid=26336): stderr: | 20221214080417759 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080417759 DLGLOBAL DEBUG validating counter group 0x7ff96df2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080417759 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080417759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080417759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080417760 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080417761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080417762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080417762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080417762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:04:18.689960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26329): Terminating (SIGTERM) 08:04:18.729598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26332): Terminating (SIGTERM) 08:04:18.768778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26335): Terminating (SIGTERM) 08:04:18.808507 --- ParallelTerminationStrategy: PID 26329 died... 08:04:18.827653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26329): Terminated: ok {rc=0} 08:04:18.871242 --- ParallelTerminationStrategy: PID 26332 died... 08:04:18.889908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26332): Terminated: ok {rc=0} 08:04:18.933287 --- ParallelTerminationStrategy: PID 26335 died... 08:04:18.951920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26335): Terminated: ok {rc=0} 08:04:19.035585 bus /sierra_3: Setting Powered False 08:04:20.132338 bus /sierra_3: Setting Powered False 08:04:21.250065 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 08:04:22.483976 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:04:22.489587 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:04:22.521649 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 08:04:22.528304 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 08:04:22.563143 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:04:22.594587 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 08:04:22.601403 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 08:04:23.124410 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 08:04:23.129225 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 08:04:23.139981 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 08:04:23.186742 tst assert_extension.py: using LAC 39539 08:04:23.301831 tst assert_extension.py: using RAC 14 08:04:23.416834 tst assert_extension.py: using CellId 39539 08:04:23.532913 tst assert_extension.py: using BVCI 39540 08:04:23.640211 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 08:04:23.759006 tst assert_extension.py:10: start nitb and bts... 08:04:23.974527 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:04:24.624229 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26341): Launched 08:04:24.942685 run osmo-nitb_10.42.42.2(pid=26342): Launched 08:04:25.119049 run osmo-nitb_10.42.42.2(pid=26342): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26342)] 08:04:25.261424 run osmo-nitb_10.42.42.2(pid=26342): stdout: | (launched: 2022-12-14_08:04:24.884266) 08:04:25.406165 run osmo-nitb_10.42.42.2(pid=26342): stderr: | (launched: 2022-12-14_08:04:24.931356) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:04:25.550150 run osmo-nitb_10.42.42.2(pid=26342): stdout: | (launched: 2022-12-14_08:04:24.884266) 08:04:25.688024 run osmo-nitb_10.42.42.2(pid=26342): stderr: | (launched: 2022-12-14_08:04:24.931356) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26342): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26342) [trial-2401↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26342)] 08:04:26.063218 tst osmo-nitb_10.42.42.2(pid=26342): stdout: | (launched: 2022-12-14_08:04:24.884266) 08:04:26.192750 tst osmo-nitb_10.42.42.2(pid=26342): stderr: | (launched: 2022-12-14_08:04:24.931356) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:04:26.344574 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26342): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26342) [trial-2401↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26342)] [trial-2401↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 08:04:26.354124 tst assert_extension.py:12: Test FAILED (3.2 sec) 08:04:26.361547 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26341): Terminating (SIGTERM) 08:04:26.572903 --- ParallelTerminationStrategy: PID 26341 died... 08:04:26.594480 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26341): Terminated: ok {rc=0} 08:04:26.683250 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 ussd:nanobts+band-900 --------------------------------------------------------------------- 08:04:27.855305 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:04:27.860333 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:04:27.891828 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 08:04:27.918084 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 08:04:27.954562 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:04:27.987505 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 08:04:28.014631 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 08:04:28.538793 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 08:04:28.543703 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:28.554360 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 08:04:28.599342 tst assert_extension.py: using LAC 39540 08:04:28.716522 tst assert_extension.py: using RAC 15 08:04:28.832456 tst assert_extension.py: using CellId 39540 08:04:28.949595 tst assert_extension.py: using BVCI 39541 08:04:29.067905 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:29.079236 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:29.090297 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:29.101587 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:29.113126 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:04:29.124420 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 08:04:29.239521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:29.700204 run create_hlr_db(pid=26346): Launched 08:04:29.822984 bus /sierra_2: Setting Powered False 08:04:30.884197 run create_hlr_db(pid=26346): Terminated: ok {rc=0} 08:04:31.316354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26348): Launched 08:04:31.636042 run osmo-hlr_10.42.42.2(pid=26349): Launched 08:04:31.833243 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:32.580142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26351): Launched 08:04:32.878093 run osmo-stp_10.42.42.5(pid=26352): Launched 08:04:32.990721 run osmo-msc_10.42.42.6: Starting osmo-msc 08:04:33.525106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26354): Launched 08:04:33.822847 run osmo-msc_10.42.42.6(pid=26355): Launched 08:04:33.988653 run osmo-stp_10.42.42.5(pid=26352): ERR: Terminated: ERROR {rc=1} [trial-2401↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26352)] 08:04:34.113258 run osmo-stp_10.42.42.5(pid=26352): stdout: | (launched: 2022-12-14_08:04:32.822544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:34.237716 run osmo-stp_10.42.42.5(pid=26352): stderr: | 20221214080432989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080432989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080432989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080432989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080432990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080432990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080432990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:34.360445 run osmo-stp_10.42.42.5(pid=26352): stdout: | (launched: 2022-12-14_08:04:32.822544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:34.478264 run osmo-stp_10.42.42.5(pid=26352): stderr: | 20221214080432989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080432989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080432989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080432989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080432990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080432990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080432990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:34.618921 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26352): Process ended prematurely: osmo-stp_10.42.42.5(pid=26352) [trial-2401↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26352)] [trial-2401↪ussd:nanobts+band-900↪assert_extension.py:17] 08:04:34.627008 tst assert_extension.py:17: Test FAILED (6.1 sec) 08:04:34.652685 run osmo-hlr_10.42.42.2(pid=26349): ERR: Terminated: ERROR {rc=237} [trial-2401↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26349)] 08:04:34.699893 run osmo-hlr_10.42.42.2(pid=26349): stdout: | (launched: 2022-12-14_08:04:31.576055) 08:04:34.748705 run osmo-hlr_10.42.42.2(pid=26349): stderr: | 20221214080431980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080431980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080431980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080431981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080431981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080431981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080432006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080432027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080432027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080432028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:34.816701 run osmo-msc_10.42.42.6(pid=26355): ERR: Terminated: ERROR {rc=2} [trial-2401↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26355)] 08:04:34.863894 run osmo-msc_10.42.42.6(pid=26355): stdout: | (launched: 2022-12-14_08:04:33.766732) 08:04:34.912683 run osmo-msc_10.42.42.6(pid=26355): stderr: | 20221214080434034 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080434034 DLGLOBAL DEBUG validating counter group 0x7f75249ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080434034 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080434034 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080434034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080434035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080434036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080434037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080434037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080434037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:04:34.961943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26348): Terminating (SIGTERM) 08:04:35.001298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26351): Terminating (SIGTERM) 08:04:35.040489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26354): Terminating (SIGTERM) 08:04:35.079895 --- ParallelTerminationStrategy: PID 26348 died... 08:04:35.098774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26348): Terminated: ok {rc=0} 08:04:35.142368 --- ParallelTerminationStrategy: PID 26351 died... 08:04:35.160564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26351): Terminated: ok {rc=0} 08:04:35.203946 --- ParallelTerminationStrategy: PID 26354 died... 08:04:35.222257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26354): Terminated: ok {rc=0} 08:04:35.307018 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:04:36.519229 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:04:36.526533 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:04:36.557976 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:04:36.584487 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:04:36.635085 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:04:36.668391 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:04:36.695911 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:04:37.244186 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:04:37.293504 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:37.304454 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:04:37.368930 tst mo_mt_call.py: using LAC 39541 08:04:37.485729 tst mo_mt_call.py: using RAC 16 08:04:37.612235 tst mo_mt_call.py: using CellId 39541 08:04:37.738114 tst mo_mt_call.py: using BVCI 39542 08:04:37.855887 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:37.867503 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:37.878950 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:37.890400 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:37.902249 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:37.913868 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:04:38.032891 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:04:38.150369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:38.621669 run create_hlr_db(pid=26361): Launched 08:04:38.746107 bus /sierra_2: Setting Powered False 08:04:39.806851 run create_hlr_db(pid=26361): Terminated: ok {rc=0} 08:04:40.248771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26363): Launched 08:04:40.574197 run osmo-hlr_10.42.42.2(pid=26365): Launched 08:04:40.697936 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:41.253456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26367): Launched 08:04:41.580269 run osmo-stp_10.42.42.5(pid=26368): Launched 08:04:41.704820 run osmo-msc_10.42.42.6: Starting osmo-msc 08:04:42.290407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26370): Launched 08:04:42.616908 run osmo-msc_10.42.42.6(pid=26371): Launched 08:04:42.797338 run osmo-stp_10.42.42.5(pid=26368): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26368)] 08:04:42.935850 run osmo-stp_10.42.42.5(pid=26368): stdout: | (launched: 2022-12-14_08:04:41.520398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:43.073696 run osmo-stp_10.42.42.5(pid=26368): stderr: | 20221214080441710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080441710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080441710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080441710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080441711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080441711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080441711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:43.208553 run osmo-stp_10.42.42.5(pid=26368): stdout: | (launched: 2022-12-14_08:04:41.520398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:43.336670 run osmo-stp_10.42.42.5(pid=26368): stderr: | 20221214080441710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080441710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080441710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080441710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080441711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080441711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080441711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:43.491353 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26368): Process ended prematurely: osmo-stp_10.42.42.5(pid=26368) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26368)] [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:04:43.500590 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:04:43.528251 run osmo-hlr_10.42.42.2(pid=26365): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26365)] 08:04:43.578733 run osmo-hlr_10.42.42.2(pid=26365): stdout: | (launched: 2022-12-14_08:04:40.514751) 08:04:43.630428 run osmo-hlr_10.42.42.2(pid=26365): stderr: | 20221214080440712 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080440712 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080440712 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080440712 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080440712 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080440712 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080440723 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080440731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080440731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080440732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:43.702781 run osmo-msc_10.42.42.6(pid=26371): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26371)] 08:04:43.752162 run osmo-msc_10.42.42.6(pid=26371): stdout: | (launched: 2022-12-14_08:04:42.556935) 08:04:43.803660 run osmo-msc_10.42.42.6(pid=26371): stderr: | 20221214080442878 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080442878 DLGLOBAL DEBUG validating counter group 0x7f47e424cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080442879 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080442879 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080442879 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080442879 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080442881 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080442881 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080442881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080442881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:04:43.855556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26363): Terminating (SIGTERM) 08:04:43.897322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26367): Terminating (SIGTERM) 08:04:43.939038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26370): Terminating (SIGTERM) 08:04:43.981248 --- ParallelTerminationStrategy: PID 26363 died... 08:04:44.001493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26363): Terminated: ok {rc=0} 08:04:44.047411 --- ParallelTerminationStrategy: PID 26367 died... 08:04:44.067099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26367): Terminated: ok {rc=0} 08:04:44.113176 --- ParallelTerminationStrategy: PID 26370 died... 08:04:44.132770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26370): Terminated: ok {rc=0} 08:04:44.220821 bus /sierra_3: Setting Powered False 08:04:45.319167 bus /sierra_3: Setting Powered False 08:04:46.453615 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:04:47.610712 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:47.623052 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:04:47.692519 tst mo_mt_call_osmux.py: using LAC 39542 08:04:47.819823 tst mo_mt_call_osmux.py: using RAC 17 08:04:47.940256 tst mo_mt_call_osmux.py: using CellId 39542 08:04:48.062159 tst mo_mt_call_osmux.py: using BVCI 39543 08:04:48.174251 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:48.185661 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:48.196515 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:48.207548 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:48.218536 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:04:48.229472 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:04:48.350808 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:04:48.472359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:48.974688 run create_hlr_db(pid=26373): Launched 08:04:49.099493 bus /sierra_2: Setting Powered False 08:04:50.162974 run create_hlr_db(pid=26373): Terminated: ok {rc=0} 08:04:50.615972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26375): Launched 08:04:50.921670 run osmo-hlr_10.42.42.2(pid=26376): Launched 08:04:51.037818 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:51.563551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26378): Launched 08:04:51.868662 run osmo-stp_10.42.42.5(pid=26379): Launched 08:04:51.984734 run osmo-msc_10.42.42.6: Starting osmo-msc 08:04:52.532604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26381): Launched 08:04:52.837648 run osmo-msc_10.42.42.6(pid=26382): Launched 08:04:53.008250 run osmo-stp_10.42.42.5(pid=26379): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26379)] 08:04:53.137290 run osmo-stp_10.42.42.5(pid=26379): stdout: | (launched: 2022-12-14_08:04:51.812055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:53.266306 run osmo-stp_10.42.42.5(pid=26379): stderr: | 20221214080451981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080451981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080451981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080451982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080451982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080451982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080451982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:53.392655 run osmo-stp_10.42.42.5(pid=26379): stdout: | (launched: 2022-12-14_08:04:51.812055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:53.513129 run osmo-stp_10.42.42.5(pid=26379): stderr: | 20221214080451981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080451981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080451981 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080451982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080451982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080451982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080451982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:53.658007 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26379): Process ended prematurely: osmo-stp_10.42.42.5(pid=26379) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26379)] [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:04:53.666833 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:04:53.692913 run osmo-hlr_10.42.42.2(pid=26376): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26376)] 08:04:53.740008 run osmo-hlr_10.42.42.2(pid=26376): stdout: | (launched: 2022-12-14_08:04:50.865428) 08:04:53.789113 run osmo-hlr_10.42.42.2(pid=26376): stderr: | 20221214080451038 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080451038 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080451038 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080451038 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080451038 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080451038 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080451051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080451061 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080451062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080451062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:53.857520 run osmo-msc_10.42.42.6(pid=26382): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26382)] 08:04:53.904522 run osmo-msc_10.42.42.6(pid=26382): stdout: | (launched: 2022-12-14_08:04:52.780872) 08:04:53.953377 run osmo-msc_10.42.42.6(pid=26382): stderr: | 20221214080453049 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080453050 DLGLOBAL DEBUG validating counter group 0x7f61d2a5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080453050 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080453050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080453050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080453050 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080453052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080453052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080453052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080453053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:04:54.002508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26375): Terminating (SIGTERM) 08:04:54.042162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26378): Terminating (SIGTERM) 08:04:54.081891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26381): Terminating (SIGTERM) 08:04:54.121886 --- ParallelTerminationStrategy: PID 26375 died... 08:04:54.140713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26375): Terminated: ok {rc=0} 08:04:54.184450 --- ParallelTerminationStrategy: PID 26378 died... 08:04:54.202943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26378): Terminated: ok {rc=0} 08:04:54.246340 --- ParallelTerminationStrategy: PID 26381 died... 08:04:54.264846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26381): Terminated: ok {rc=0} 08:04:54.347519 bus /sierra_3: Setting Powered False 08:04:55.445653 bus /sierra_3: Setting Powered False 08:04:56.560277 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:04:57.813556 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:04:57.821576 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:04:57.853927 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:04:57.881957 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:04:57.934683 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:04:57.965925 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:04:57.991700 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:04:58.545958 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:04:58.598440 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:04:58.610044 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:04:58.678260 tst mo_mt_call.py: using LAC 39543 08:04:58.806603 tst mo_mt_call.py: using RAC 18 08:04:58.933470 tst mo_mt_call.py: using CellId 39543 08:04:59.060730 tst mo_mt_call.py: using BVCI 39544 08:04:59.172470 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:04:59.183691 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:04:59.194713 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:04:59.205955 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:04:59.217235 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:04:59.228165 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:04:59.349493 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:04:59.470440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:59.972084 run create_hlr_db(pid=26388): Launched 08:05:00.095507 bus /sierra_2: Setting Powered False 08:05:01.180277 run create_hlr_db(pid=26388): Terminated: ok {rc=0} 08:05:01.625963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26390): Launched 08:05:01.958658 run osmo-hlr_10.42.42.2(pid=26394): Launched 08:05:02.155414 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:02.715928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26396): Launched 08:05:03.019519 run osmo-stp_10.42.42.5(pid=26397): Launched 08:05:03.145143 run osmo-msc_10.42.42.6: Starting osmo-msc 08:05:03.734071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26399): Launched 08:05:04.061565 run osmo-msc_10.42.42.6(pid=26400): Launched 08:05:04.244412 run osmo-stp_10.42.42.5(pid=26397): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26397)] 08:05:04.381778 run osmo-stp_10.42.42.5(pid=26397): stdout: | (launched: 2022-12-14_08:05:02.962734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:04.520131 run osmo-stp_10.42.42.5(pid=26397): stderr: | 20221214080503147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080503147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080503147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080503147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080503148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080503148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080503148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:04.656231 run osmo-stp_10.42.42.5(pid=26397): stdout: | (launched: 2022-12-14_08:05:02.962734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:04.785796 run osmo-stp_10.42.42.5(pid=26397): stderr: | 20221214080503147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080503147 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080503147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080503147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080503148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080503148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080503148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:04.940734 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26397): Process ended prematurely: osmo-stp_10.42.42.5(pid=26397) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26397)] [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:05:04.950349 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 08:05:04.977790 run osmo-hlr_10.42.42.2(pid=26394): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26394)] 08:05:05.027951 run osmo-hlr_10.42.42.2(pid=26394): stdout: | (launched: 2022-12-14_08:05:01.899062) 08:05:05.079571 run osmo-hlr_10.42.42.2(pid=26394): stderr: | 20221214080502228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080502228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080502228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080502228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080502229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080502229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080502243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080502251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080502251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080502251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:05.151849 run osmo-msc_10.42.42.6(pid=26400): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26400)] 08:05:05.201153 run osmo-msc_10.42.42.6(pid=26400): stdout: | (launched: 2022-12-14_08:05:04.001497) 08:05:05.252569 run osmo-msc_10.42.42.6(pid=26400): stderr: | 20221214080504320 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080504320 DLGLOBAL DEBUG validating counter group 0x7fdb733f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080504320 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080504320 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080504320 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080504321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080504322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080504323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080504323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080504323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:05:05.304360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26390): Terminating (SIGTERM) 08:05:05.346186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26396): Terminating (SIGTERM) 08:05:05.387732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26399): Terminating (SIGTERM) 08:05:05.430621 --- ParallelTerminationStrategy: PID 26390 died... 08:05:05.450817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26390): Terminated: ok {rc=0} 08:05:05.497023 --- ParallelTerminationStrategy: PID 26396 died... 08:05:05.516790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26396): Terminated: ok {rc=0} 08:05:05.562767 --- ParallelTerminationStrategy: PID 26399 died... 08:05:05.582499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26399): Terminated: ok {rc=0} 08:05:05.671136 bus /sierra_3: Setting Powered False 08:05:06.769464 bus /sierra_3: Setting Powered False 08:05:07.885285 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:05:09.033330 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:05:09.045664 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:05:09.114475 tst mo_mt_call_osmux.py: using LAC 39544 08:05:09.241701 tst mo_mt_call_osmux.py: using RAC 19 08:05:09.364385 tst mo_mt_call_osmux.py: using CellId 39544 08:05:09.483751 tst mo_mt_call_osmux.py: using BVCI 39545 08:05:09.595207 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:05:09.606559 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:05:09.617747 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:05:09.628742 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:05:09.639760 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:05:09.650690 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:05:09.772608 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:05:09.890916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:10.361943 run create_hlr_db(pid=26402): Launched 08:05:10.486621 bus /sierra_2: Setting Powered False 08:05:11.547031 run create_hlr_db(pid=26402): Terminated: ok {rc=0} 08:05:11.970552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26404): Launched 08:05:12.274566 run osmo-hlr_10.42.42.2(pid=26405): Launched 08:05:12.388720 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:12.927489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26407): Launched 08:05:13.231854 run osmo-stp_10.42.42.5(pid=26408): Launched 08:05:13.347161 run osmo-msc_10.42.42.6: Starting osmo-msc 08:05:13.894299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26410): Launched 08:05:14.197994 run osmo-msc_10.42.42.6(pid=26411): Launched 08:05:14.367168 run osmo-stp_10.42.42.5(pid=26408): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26408)] 08:05:14.495071 run osmo-stp_10.42.42.5(pid=26408): stdout: | (launched: 2022-12-14_08:05:13.175226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:14.622026 run osmo-stp_10.42.42.5(pid=26408): stderr: | 20221214080513343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080513343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080513344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080513344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080513344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080513345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080513345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:14.748479 run osmo-stp_10.42.42.5(pid=26408): stdout: | (launched: 2022-12-14_08:05:13.175226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:14.868097 run osmo-stp_10.42.42.5(pid=26408): stderr: | 20221214080513343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080513343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080513344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080513344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080513344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080513345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080513345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:15.011493 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26408): Process ended prematurely: osmo-stp_10.42.42.5(pid=26408) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26408)] [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:05:15.020281 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:05:15.046360 run osmo-hlr_10.42.42.2(pid=26405): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26405)] 08:05:15.093274 run osmo-hlr_10.42.42.2(pid=26405): stdout: | (launched: 2022-12-14_08:05:12.218173) 08:05:15.142017 run osmo-hlr_10.42.42.2(pid=26405): stderr: | 20221214080512393 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080512393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080512393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080512393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080512393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080512393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080512405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080512414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080512414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080512414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:15.209991 run osmo-msc_10.42.42.6(pid=26411): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26411)] 08:05:15.256537 run osmo-msc_10.42.42.6(pid=26411): stdout: | (launched: 2022-12-14_08:05:14.141528) 08:05:15.304877 run osmo-msc_10.42.42.6(pid=26411): stderr: | 20221214080514411 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080514411 DLGLOBAL DEBUG validating counter group 0x7f73884c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080514411 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080514411 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080514412 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080514412 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080514414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080514414 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080514414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080514414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:05:15.353495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26404): Terminating (SIGTERM) 08:05:15.392633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26407): Terminating (SIGTERM) 08:05:15.431700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26410): Terminating (SIGTERM) 08:05:15.471164 --- ParallelTerminationStrategy: PID 26404 died... 08:05:15.490135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26404): Terminated: ok {rc=0} 08:05:15.533351 --- ParallelTerminationStrategy: PID 26407 died... 08:05:15.551776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26407): Terminated: ok {rc=0} 08:05:15.594810 --- ParallelTerminationStrategy: PID 26410 died... 08:05:15.613256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26410): Terminated: ok {rc=0} 08:05:15.697553 bus /sierra_3: Setting Powered False 08:05:16.812137 bus /sierra_3: Setting Powered False 08:05:17.950779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:05:19.196282 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:05:19.203831 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:05:19.235389 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:05:19.261694 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:05:19.313047 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:05:19.346178 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:05:19.373763 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:05:19.921850 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:05:19.969952 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:19.981208 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:05:20.047711 tst mo_mt_call.py: using LAC 39545 08:05:20.165308 tst mo_mt_call.py: using RAC 20 08:05:20.283897 tst mo_mt_call.py: using CellId 39545 08:05:20.404676 tst mo_mt_call.py: using BVCI 39546 08:05:20.514953 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:20.526243 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:20.537313 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:20.548251 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:20.559580 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:20.570982 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:05:20.694250 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:05:20.813557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:21.317506 run create_hlr_db(pid=26416): Launched 08:05:21.444518 bus /sierra_2: Setting Powered False 08:05:22.508667 run create_hlr_db(pid=26416): Terminated: ok {rc=0} 08:05:22.942946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26418): Launched 08:05:23.246583 run osmo-hlr_10.42.42.2(pid=26419): Launched 08:05:23.361949 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:23.882395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26421): Launched 08:05:24.185669 run osmo-stp_10.42.42.5(pid=26422): Launched 08:05:24.302049 run osmo-msc_10.42.42.6: Starting osmo-msc 08:05:24.853735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26424): Launched 08:05:25.159029 run osmo-msc_10.42.42.6(pid=26425): Launched 08:05:25.328274 run osmo-stp_10.42.42.5(pid=26422): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26422)] 08:05:25.455531 run osmo-stp_10.42.42.5(pid=26422): stdout: | (launched: 2022-12-14_08:05:24.129437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:25.582601 run osmo-stp_10.42.42.5(pid=26422): stderr: | 20221214080524296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080524296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080524296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080524297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080524297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080524298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080524298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:25.707525 run osmo-stp_10.42.42.5(pid=26422): stdout: | (launched: 2022-12-14_08:05:24.129437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:25.826633 run osmo-stp_10.42.42.5(pid=26422): stderr: | 20221214080524296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080524296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080524296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080524297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080524297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080524298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080524298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:25.969870 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26422): Process ended prematurely: osmo-stp_10.42.42.5(pid=26422) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26422)] [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:05:25.978561 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:05:26.004530 run osmo-hlr_10.42.42.2(pid=26419): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26419)] 08:05:26.051688 run osmo-hlr_10.42.42.2(pid=26419): stdout: | (launched: 2022-12-14_08:05:23.190293) 08:05:26.100479 run osmo-hlr_10.42.42.2(pid=26419): stderr: | 20221214080523363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080523363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080523363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080523363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080523363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080523363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080523376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080523384 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080523384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080523384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:26.168557 run osmo-msc_10.42.42.6(pid=26425): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26425)] 08:05:26.215532 run osmo-msc_10.42.42.6(pid=26425): stdout: | (launched: 2022-12-14_08:05:25.102476) 08:05:26.264078 run osmo-msc_10.42.42.6(pid=26425): stderr: | 20221214080525370 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080525370 DLGLOBAL DEBUG validating counter group 0x7fce2bf9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080525370 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080525370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080525370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080525371 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080525372 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080525373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080525373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080525373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:05:26.312737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26418): Terminating (SIGTERM) 08:05:26.351711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26421): Terminating (SIGTERM) 08:05:26.390698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26424): Terminating (SIGTERM) 08:05:26.430160 --- ParallelTerminationStrategy: PID 26418 died... 08:05:26.449100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26418): Terminated: ok {rc=0} 08:05:26.492271 --- ParallelTerminationStrategy: PID 26421 died... 08:05:26.510837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26421): Terminated: ok {rc=0} 08:05:26.553764 --- ParallelTerminationStrategy: PID 26424 died... 08:05:26.572154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26424): Terminated: ok {rc=0} 08:05:26.656368 bus /sierra_3: Setting Powered False 08:05:27.755585 bus /sierra_3: Setting Powered False 08:05:28.872582 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:05:30.020141 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:30.032859 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:05:30.102556 tst mo_mt_call_osmux.py: using LAC 39546 08:05:30.233436 tst mo_mt_call_osmux.py: using RAC 21 08:05:30.362763 tst mo_mt_call_osmux.py: using CellId 39546 08:05:30.493136 tst mo_mt_call_osmux.py: using BVCI 39547 08:05:30.611894 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:30.623591 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:30.635100 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:30.646549 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:30.658523 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:05:30.670486 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:05:30.789487 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:05:30.927495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:31.413153 run create_hlr_db(pid=26427): Launched 08:05:31.585860 bus /sierra_2: Setting Powered False 08:05:32.647085 run create_hlr_db(pid=26427): Terminated: ok {rc=0} 08:05:33.094308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26429): Launched 08:05:33.423631 run osmo-hlr_10.42.42.2(pid=26430): Launched 08:05:33.549381 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:34.113534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26432): Launched 08:05:34.440586 run osmo-stp_10.42.42.5(pid=26433): Launched 08:05:34.564897 run osmo-msc_10.42.42.6: Starting osmo-msc 08:05:35.151610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26435): Launched 08:05:35.477753 run osmo-msc_10.42.42.6(pid=26436): Launched 08:05:35.658680 run osmo-stp_10.42.42.5(pid=26433): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26433)] 08:05:35.795246 run osmo-stp_10.42.42.5(pid=26433): stdout: | (launched: 2022-12-14_08:05:34.380797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:35.933328 run osmo-stp_10.42.42.5(pid=26433): stderr: | 20221214080534570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080534570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080534570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080534570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080534571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080534571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080534571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:36.069325 run osmo-stp_10.42.42.5(pid=26433): stdout: | (launched: 2022-12-14_08:05:34.380797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:36.198298 run osmo-stp_10.42.42.5(pid=26433): stderr: | 20221214080534570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080534570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080534570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080534570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080534571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080534571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080534571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:36.352763 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26433): Process ended prematurely: osmo-stp_10.42.42.5(pid=26433) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26433)] [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:05:36.362581 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 08:05:36.390253 run osmo-hlr_10.42.42.2(pid=26430): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26430)] 08:05:36.440777 run osmo-hlr_10.42.42.2(pid=26430): stdout: | (launched: 2022-12-14_08:05:33.362226) 08:05:36.492540 run osmo-hlr_10.42.42.2(pid=26430): stderr: | 20221214080533558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080533558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080533558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080533558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080533558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080533558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080533570 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080533578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080533579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080533579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:36.564817 run osmo-msc_10.42.42.6(pid=26436): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26436)] 08:05:36.614088 run osmo-msc_10.42.42.6(pid=26436): stdout: | (launched: 2022-12-14_08:05:35.417465) 08:05:36.665477 run osmo-msc_10.42.42.6(pid=26436): stderr: | 20221214080535737 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080535737 DLGLOBAL DEBUG validating counter group 0x7f2988dfcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080535737 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080535737 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080535737 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080535737 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080535739 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080535739 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080535739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080535740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:05:36.717353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26429): Terminating (SIGTERM) 08:05:36.759481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26432): Terminating (SIGTERM) 08:05:36.801962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26435): Terminating (SIGTERM) 08:05:36.844470 --- ParallelTerminationStrategy: PID 26429 died... 08:05:36.864835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26429): Terminated: ok {rc=0} 08:05:36.911114 --- ParallelTerminationStrategy: PID 26432 died... 08:05:36.931164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26432): Terminated: ok {rc=0} 08:05:36.977528 --- ParallelTerminationStrategy: PID 26435 died... 08:05:36.997422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26435): Terminated: ok {rc=0} 08:05:37.085846 bus /sierra_3: Setting Powered False 08:05:38.183361 bus /sierra_3: Setting Powered False 08:05:39.300531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:05:40.547513 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:05:40.554833 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:05:40.586214 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:05:40.612222 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:05:40.664280 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:05:40.697234 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:05:40.724941 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:05:41.272471 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:05:41.320697 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:41.331931 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:05:41.397413 tst mo_mt_call.py: using LAC 39547 08:05:41.516128 tst mo_mt_call.py: using RAC 22 08:05:41.637083 tst mo_mt_call.py: using CellId 39547 08:05:41.756532 tst mo_mt_call.py: using BVCI 39548 08:05:41.867949 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:41.879090 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:41.890114 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:41.901500 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:41.912762 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:41.924155 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:05:42.043227 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:05:42.161604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:42.630384 run create_hlr_db(pid=26441): Launched 08:05:42.754766 bus /sierra_2: Setting Powered False 08:05:43.815055 run create_hlr_db(pid=26441): Terminated: ok {rc=0} 08:05:44.257625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26443): Launched 08:05:44.586341 run osmo-hlr_10.42.42.2(pid=26444): Launched 08:05:44.711835 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:45.274359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26446): Launched 08:05:45.583958 run osmo-stp_10.42.42.5(pid=26447): Launched 08:05:45.698200 run osmo-msc_10.42.42.6: Starting osmo-msc 08:05:46.252590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26449): Launched 08:05:46.651619 run osmo-msc_10.42.42.6(pid=26450): Launched 08:05:46.991680 run osmo-stp_10.42.42.5(pid=26447): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26447)] 08:05:47.334541 run osmo-stp_10.42.42.5(pid=26447): stdout: | (launched: 2022-12-14_08:05:45.527060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:47.507724 run osmo-stp_10.42.42.5(pid=26447): stderr: | 20221214080545697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080545697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080545697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080545698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080545698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080545698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080545698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:47.643763 run osmo-stp_10.42.42.5(pid=26447): stdout: | (launched: 2022-12-14_08:05:45.527060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:47.772643 run osmo-stp_10.42.42.5(pid=26447): stderr: | 20221214080545697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080545697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080545697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080545698 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080545698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080545698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080545698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:47.927020 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26447): Process ended prematurely: osmo-stp_10.42.42.5(pid=26447) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26447)] [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:05:47.936377 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 08:05:47.964046 run osmo-hlr_10.42.42.2(pid=26444): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26444)] 08:05:48.014403 run osmo-hlr_10.42.42.2(pid=26444): stdout: | (launched: 2022-12-14_08:05:44.526366) 08:05:48.065957 run osmo-hlr_10.42.42.2(pid=26444): stderr: | 20221214080544722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080544722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080544722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080544722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080544722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080544722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080544734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080544745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080544745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080544746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:48.138291 run osmo-msc_10.42.42.6(pid=26450): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26450)] 08:05:48.187635 run osmo-msc_10.42.42.6(pid=26450): stdout: | (launched: 2022-12-14_08:05:46.576140) 08:05:48.239111 run osmo-msc_10.42.42.6(pid=26450): stderr: | 20221214080547132 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080547133 DLGLOBAL DEBUG validating counter group 0x7fdb5c8a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080547133 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080547133 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080547133 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080547133 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080547135 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080547135 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080547135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080547135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:05:48.291238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26443): Terminating (SIGTERM) 08:05:48.333365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26446): Terminating (SIGTERM) 08:05:48.375812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26449): Terminating (SIGTERM) 08:05:48.418209 --- ParallelTerminationStrategy: PID 26443 died... 08:05:48.438580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26443): Terminated: ok {rc=0} 08:05:48.485235 --- ParallelTerminationStrategy: PID 26446 died... 08:05:48.505354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26446): Terminated: ok {rc=0} 08:05:48.551679 --- ParallelTerminationStrategy: PID 26449 died... 08:05:48.571640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26449): Terminated: ok {rc=0} 08:05:48.659538 bus /sierra_3: Setting Powered False 08:05:49.757871 bus /sierra_3: Setting Powered False 08:05:50.873991 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:05:52.020632 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:52.032409 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:05:52.101852 tst mo_mt_call_osmux.py: using LAC 39548 08:05:52.233120 tst mo_mt_call_osmux.py: using RAC 23 08:05:52.360913 tst mo_mt_call_osmux.py: using CellId 39548 08:05:52.486982 tst mo_mt_call_osmux.py: using BVCI 39549 08:05:52.606475 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:52.618421 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:52.630126 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:52.641788 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:52.653822 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:05:52.665705 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:05:52.787194 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:05:52.906316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:53.377027 run create_hlr_db(pid=26453): Launched 08:05:53.501427 bus /sierra_2: Setting Powered False 08:05:54.561677 run create_hlr_db(pid=26453): Terminated: ok {rc=0} 08:05:55.005916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26455): Launched 08:05:55.332480 run osmo-hlr_10.42.42.2(pid=26456): Launched 08:05:55.456847 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:56.019005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26458): Launched 08:05:56.345928 run osmo-stp_10.42.42.5(pid=26459): Launched 08:05:56.471368 run osmo-msc_10.42.42.6: Starting osmo-msc 08:05:57.059267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26461): Launched 08:05:57.385579 run osmo-msc_10.42.42.6(pid=26462): Launched 08:05:57.569546 run osmo-stp_10.42.42.5(pid=26459): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26459)] 08:05:57.707503 run osmo-stp_10.42.42.5(pid=26459): stdout: | (launched: 2022-12-14_08:05:56.286118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:57.846373 run osmo-stp_10.42.42.5(pid=26459): stderr: | 20221214080556476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080556476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080556477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080556477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080556477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080556478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080556478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:57.982654 run osmo-stp_10.42.42.5(pid=26459): stdout: | (launched: 2022-12-14_08:05:56.286118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:58.112543 run osmo-stp_10.42.42.5(pid=26459): stderr: | 20221214080556476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080556476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080556477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080556477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080556477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080556478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080556478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:58.268531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26459): Process ended prematurely: osmo-stp_10.42.42.5(pid=26459) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26459)] [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:05:58.278356 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:05:58.306147 run osmo-hlr_10.42.42.2(pid=26456): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26456)] 08:05:58.356396 run osmo-hlr_10.42.42.2(pid=26456): stdout: | (launched: 2022-12-14_08:05:55.273120) 08:05:58.407905 run osmo-hlr_10.42.42.2(pid=26456): stderr: | 20221214080555469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080555469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080555469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080555469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080555469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080555469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080555482 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080555490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080555490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080555491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:58.480257 run osmo-msc_10.42.42.6(pid=26462): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26462)] 08:05:58.529798 run osmo-msc_10.42.42.6(pid=26462): stdout: | (launched: 2022-12-14_08:05:57.325679) 08:05:58.581212 run osmo-msc_10.42.42.6(pid=26462): stderr: | 20221214080557650 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080557650 DLGLOBAL DEBUG validating counter group 0x7fbee0b04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080557650 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080557650 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080557651 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080557651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080557652 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080557653 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080557653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080557653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:05:58.632903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26455): Terminating (SIGTERM) 08:05:58.674904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26458): Terminating (SIGTERM) 08:05:58.716616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26461): Terminating (SIGTERM) 08:05:58.759083 --- ParallelTerminationStrategy: PID 26455 died... 08:05:58.779326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26455): Terminated: ok {rc=0} 08:05:58.825410 --- ParallelTerminationStrategy: PID 26458 died... 08:05:58.845087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26458): Terminated: ok {rc=0} 08:05:58.890720 --- ParallelTerminationStrategy: PID 26461 died... 08:05:58.910414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26461): Terminated: ok {rc=0} 08:05:58.997486 bus /sierra_3: Setting Powered False 08:06:00.094765 bus /sierra_3: Setting Powered False 08:06:01.217854 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:06:02.487776 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:06:02.497985 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:06:02.530931 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:06:02.558239 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:06:02.611481 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:06:02.643034 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:06:02.669284 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:06:03.221618 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:06:03.271221 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:03.282718 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:06:03.349266 tst mo_mt_call.py: using LAC 39549 08:06:03.466923 tst mo_mt_call.py: using RAC 24 08:06:03.584315 tst mo_mt_call.py: using CellId 39549 08:06:03.702299 tst mo_mt_call.py: using BVCI 39550 08:06:03.813733 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:03.825170 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:03.836079 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:03.847047 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:03.858781 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:03.870480 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:06:03.991371 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:06:04.115828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:04.619210 run create_hlr_db(pid=26467): Launched 08:06:04.743575 bus /sierra_2: Setting Powered False 08:06:05.808062 run create_hlr_db(pid=26467): Terminated: ok {rc=0} 08:06:06.241816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26469): Launched 08:06:06.546021 run osmo-hlr_10.42.42.2(pid=26470): Launched 08:06:06.662930 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:07.198501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26472): Launched 08:06:07.501195 run osmo-stp_10.42.42.5(pid=26473): Launched 08:06:07.616674 run osmo-msc_10.42.42.6: Starting osmo-msc 08:06:08.165556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26475): Launched 08:06:08.471476 run osmo-msc_10.42.42.6(pid=26476): Launched 08:06:08.640431 run osmo-stp_10.42.42.5(pid=26473): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26473)] 08:06:08.767156 run osmo-stp_10.42.42.5(pid=26473): stdout: | (launched: 2022-12-14_08:06:07.445104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:08.894286 run osmo-stp_10.42.42.5(pid=26473): stderr: | 20221214080607611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080607611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080607611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080607612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080607612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080607612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080607612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:09.019698 run osmo-stp_10.42.42.5(pid=26473): stdout: | (launched: 2022-12-14_08:06:07.445104) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:09.139300 run osmo-stp_10.42.42.5(pid=26473): stderr: | 20221214080607611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080607611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080607611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080607612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080607612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080607612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080607612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:09.283375 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26473): Process ended prematurely: osmo-stp_10.42.42.5(pid=26473) [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26473)] [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:06:09.292268 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:06:09.318682 run osmo-hlr_10.42.42.2(pid=26470): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26470)] 08:06:09.366025 run osmo-hlr_10.42.42.2(pid=26470): stdout: | (launched: 2022-12-14_08:06:06.490274) 08:06:09.414712 run osmo-hlr_10.42.42.2(pid=26470): stderr: | 20221214080606663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080606663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080606663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080606663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080606663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080606663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080606675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080606683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080606684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080606684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:09.482682 run osmo-msc_10.42.42.6(pid=26476): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26476)] 08:06:09.529633 run osmo-msc_10.42.42.6(pid=26476): stdout: | (launched: 2022-12-14_08:06:08.414631) 08:06:09.578094 run osmo-msc_10.42.42.6(pid=26476): stderr: | 20221214080608686 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080608686 DLGLOBAL DEBUG validating counter group 0x7fdf4ccb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080608686 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080608686 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080608686 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080608686 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080608688 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080608688 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080608689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080608689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:06:09.626941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26469): Terminating (SIGTERM) 08:06:09.666386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26472): Terminating (SIGTERM) 08:06:09.705800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26475): Terminating (SIGTERM) 08:06:09.745551 --- ParallelTerminationStrategy: PID 26469 died... 08:06:09.764631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26469): Terminated: ok {rc=0} 08:06:09.808246 --- ParallelTerminationStrategy: PID 26472 died... 08:06:09.826780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26472): Terminated: ok {rc=0} 08:06:09.870300 --- ParallelTerminationStrategy: PID 26475 died... 08:06:09.888843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26475): Terminated: ok {rc=0} 08:06:09.971590 bus /sierra_3: Setting Powered False 08:06:11.067590 bus /sierra_3: Setting Powered False 08:06:12.184255 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:06:13.325733 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:13.337689 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:06:13.405251 tst mo_mt_call_osmux.py: using LAC 39550 08:06:13.523382 tst mo_mt_call_osmux.py: using RAC 25 08:06:13.643627 tst mo_mt_call_osmux.py: using CellId 39550 08:06:13.768612 tst mo_mt_call_osmux.py: using BVCI 39551 08:06:13.879343 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:13.890592 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:13.901904 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:13.913113 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:13.924365 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:06:13.935393 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:06:14.051398 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:06:14.172133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:14.674952 run create_hlr_db(pid=26478): Launched 08:06:14.799307 bus /sierra_2: Setting Powered False 08:06:15.864151 run create_hlr_db(pid=26478): Terminated: ok {rc=0} 08:06:16.303426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26480): Launched 08:06:16.630094 run osmo-hlr_10.42.42.2(pid=26481): Launched 08:06:16.817437 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:17.446654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26483): Launched 08:06:17.764174 run osmo-stp_10.42.42.5(pid=26484): Launched 08:06:17.879359 run osmo-msc_10.42.42.6: Starting osmo-msc 08:06:18.429268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26486): Launched 08:06:18.732554 run osmo-msc_10.42.42.6(pid=26487): Launched 08:06:18.900743 run osmo-stp_10.42.42.5(pid=26484): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26484)] 08:06:19.028084 run osmo-stp_10.42.42.5(pid=26484): stdout: | (launched: 2022-12-14_08:06:17.707657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:19.155390 run osmo-stp_10.42.42.5(pid=26484): stderr: | 20221214080617878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080617878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080617878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080617878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080617879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080617879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080617879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:19.282383 run osmo-stp_10.42.42.5(pid=26484): stdout: | (launched: 2022-12-14_08:06:17.707657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:19.402126 run osmo-stp_10.42.42.5(pid=26484): stderr: | 20221214080617878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080617878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080617878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080617878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080617879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080617879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080617879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:19.546195 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26484): Process ended prematurely: osmo-stp_10.42.42.5(pid=26484) [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26484)] [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:06:19.555030 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 08:06:19.581094 run osmo-hlr_10.42.42.2(pid=26481): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26481)] 08:06:19.628123 run osmo-hlr_10.42.42.2(pid=26481): stdout: | (launched: 2022-12-14_08:06:16.569730) 08:06:19.676766 run osmo-hlr_10.42.42.2(pid=26481): stderr: | 20221214080616956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080616956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080616956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080616956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080616956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080616956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080616983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080617003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080617003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080617003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:19.744623 run osmo-msc_10.42.42.6(pid=26487): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26487)] 08:06:19.791277 run osmo-msc_10.42.42.6(pid=26487): stdout: | (launched: 2022-12-14_08:06:18.676508) 08:06:19.839654 run osmo-msc_10.42.42.6(pid=26487): stderr: | 20221214080618947 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080618947 DLGLOBAL DEBUG validating counter group 0x7fd862e13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080618947 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080618948 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080618948 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080618948 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080618950 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080618950 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080618950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080618950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:06:19.888128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26480): Terminating (SIGTERM) 08:06:19.927247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26483): Terminating (SIGTERM) 08:06:19.966217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26486): Terminating (SIGTERM) 08:06:20.005785 --- ParallelTerminationStrategy: PID 26480 died... 08:06:20.024890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26480): Terminated: ok {rc=0} 08:06:20.068315 --- ParallelTerminationStrategy: PID 26483 died... 08:06:20.086911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26483): Terminated: ok {rc=0} 08:06:20.130213 --- ParallelTerminationStrategy: PID 26486 died... 08:06:20.148765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26486): Terminated: ok {rc=0} 08:06:20.234086 bus /sierra_3: Setting Powered False 08:06:21.332513 bus /sierra_3: Setting Powered False 08:06:22.446970 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:06:23.703586 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:06:23.711902 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:06:23.743879 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 08:06:23.771122 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 08:06:23.820228 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:06:23.852104 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 08:06:23.878913 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 08:06:24.432267 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 08:06:24.482083 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:24.493581 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:06:24.540926 tst mo_mt_call.py: using LAC 39551 08:06:24.658332 tst mo_mt_call.py: using RAC 26 08:06:24.776016 tst mo_mt_call.py: using CellId 39551 08:06:24.893368 tst mo_mt_call.py: using BVCI 39552 08:06:25.002973 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:25.014469 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:25.025607 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:25.036580 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:25.047718 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:25.058868 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:06:25.175139 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:06:25.297018 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:25.802860 run create_hlr_db(pid=26492): Launched 08:06:25.927349 bus /sierra_2: Setting Powered False 08:06:26.991308 run create_hlr_db(pid=26492): Terminated: ok {rc=0} 08:06:27.427366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26494): Launched 08:06:27.730859 run osmo-hlr_10.42.42.2(pid=26495): Launched 08:06:27.846351 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:28.385737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26497): Launched 08:06:28.689874 run osmo-stp_10.42.42.5(pid=26498): Launched 08:06:28.804611 run osmo-msc_10.42.42.6: Starting osmo-msc 08:06:29.350932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26500): Launched 08:06:29.654405 run osmo-msc_10.42.42.6(pid=26501): Launched 08:06:29.823619 run osmo-stp_10.42.42.5(pid=26498): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26498)] 08:06:29.951333 run osmo-stp_10.42.42.5(pid=26498): stdout: | (launched: 2022-12-14_08:06:28.633378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:30.078289 run osmo-stp_10.42.42.5(pid=26498): stderr: | 20221214080628803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080628803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080628804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080628804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080628804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080628805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080628805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:30.203765 run osmo-stp_10.42.42.5(pid=26498): stdout: | (launched: 2022-12-14_08:06:28.633378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:30.323192 run osmo-stp_10.42.42.5(pid=26498): stderr: | 20221214080628803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080628803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080628804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080628804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080628804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080628805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080628805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:30.466747 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26498): Process ended prematurely: osmo-stp_10.42.42.5(pid=26498) [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26498)] [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 08:06:30.475495 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 08:06:30.501714 run osmo-hlr_10.42.42.2(pid=26495): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26495)] 08:06:30.549063 run osmo-hlr_10.42.42.2(pid=26495): stdout: | (launched: 2022-12-14_08:06:27.674795) 08:06:30.597431 run osmo-hlr_10.42.42.2(pid=26495): stderr: | 20221214080627849 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080627849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080627849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080627850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080627850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080627850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080627862 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080627870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080627870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080627870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:30.665063 run osmo-msc_10.42.42.6(pid=26501): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26501)] 08:06:30.711367 run osmo-msc_10.42.42.6(pid=26501): stdout: | (launched: 2022-12-14_08:06:29.598467) 08:06:30.760080 run osmo-msc_10.42.42.6(pid=26501): stderr: | 20221214080629867 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080629867 DLGLOBAL DEBUG validating counter group 0x7fb57cbc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080629867 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080629867 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080629867 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080629867 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080629869 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080629870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080629870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080629870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:06:30.808748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26494): Terminating (SIGTERM) 08:06:30.848507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26497): Terminating (SIGTERM) 08:06:30.888113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26500): Terminating (SIGTERM) 08:06:30.928199 --- ParallelTerminationStrategy: PID 26494 died... 08:06:30.947217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26494): Terminated: ok {rc=0} 08:06:30.991047 --- ParallelTerminationStrategy: PID 26497 died... 08:06:31.009885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26497): Terminated: ok {rc=0} 08:06:31.053620 --- ParallelTerminationStrategy: PID 26500 died... 08:06:31.072621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26500): Terminated: ok {rc=0} 08:06:31.159282 bus /sierra_3: Setting Powered False 08:06:32.272065 bus /sierra_3: Setting Powered False 08:06:33.396941 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 08:06:34.542196 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:34.554321 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:06:34.605022 tst mo_mt_call_osmux.py: using LAC 39552 08:06:34.723060 tst mo_mt_call_osmux.py: using RAC 27 08:06:34.844207 tst mo_mt_call_osmux.py: using CellId 39552 08:06:34.964070 tst mo_mt_call_osmux.py: using BVCI 39553 08:06:35.075822 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:35.087194 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:35.098409 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:35.109522 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:35.120748 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:06:35.131891 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:06:35.247692 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:06:35.369570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:35.875025 run create_hlr_db(pid=26503): Launched 08:06:35.999976 bus /sierra_2: Setting Powered False 08:06:37.063562 run create_hlr_db(pid=26503): Terminated: ok {rc=0} 08:06:37.500053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26505): Launched 08:06:37.805313 run osmo-hlr_10.42.42.2(pid=26506): Launched 08:06:37.920394 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:38.446061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26508): Launched 08:06:38.749901 run osmo-stp_10.42.42.5(pid=26509): Launched 08:06:38.865062 run osmo-msc_10.42.42.6: Starting osmo-msc 08:06:39.413045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26511): Launched 08:06:39.718248 run osmo-msc_10.42.42.6(pid=26512): Launched 08:06:39.888242 run osmo-stp_10.42.42.5(pid=26509): ERR: Terminated: ERROR {rc=1} [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26509)] 08:06:40.017420 run osmo-stp_10.42.42.5(pid=26509): stdout: | (launched: 2022-12-14_08:06:38.693651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:40.144805 run osmo-stp_10.42.42.5(pid=26509): stderr: | 20221214080638862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080638862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080638862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080638863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080638863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080638863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080638863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:40.270689 run osmo-stp_10.42.42.5(pid=26509): stdout: | (launched: 2022-12-14_08:06:38.693651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:40.390395 run osmo-stp_10.42.42.5(pid=26509): stderr: | 20221214080638862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080638862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080638862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080638863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080638863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080638863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080638863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:40.534493 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26509): Process ended prematurely: osmo-stp_10.42.42.5(pid=26509) [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26509)] [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 08:06:40.543251 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:06:40.569754 run osmo-hlr_10.42.42.2(pid=26506): ERR: Terminated: ERROR {rc=237} [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26506)] 08:06:40.616864 run osmo-hlr_10.42.42.2(pid=26506): stdout: | (launched: 2022-12-14_08:06:37.748177) 08:06:40.665986 run osmo-hlr_10.42.42.2(pid=26506): stderr: | 20221214080637923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080637923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080637923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080637923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080637924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080637924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080637935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080637944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080637944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080637944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:40.734818 run osmo-msc_10.42.42.6(pid=26512): ERR: Terminated: ERROR {rc=2} [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26512)] 08:06:40.781830 run osmo-msc_10.42.42.6(pid=26512): stdout: | (launched: 2022-12-14_08:06:39.661646) 08:06:40.830750 run osmo-msc_10.42.42.6(pid=26512): stderr: | 20221214080639930 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080639930 DLGLOBAL DEBUG validating counter group 0x7fc6967eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080639930 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080639930 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080639931 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080639931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080639932 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080639933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080639933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080639933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:06:40.880082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26505): Terminating (SIGTERM) 08:06:40.919560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26508): Terminating (SIGTERM) 08:06:40.958955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26511): Terminating (SIGTERM) 08:06:40.998544 --- ParallelTerminationStrategy: PID 26505 died... 08:06:41.017316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26505): Terminated: ok {rc=0} 08:06:41.061260 --- ParallelTerminationStrategy: PID 26508 died... 08:06:41.079742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26508): Terminated: ok {rc=0} 08:06:41.123317 --- ParallelTerminationStrategy: PID 26511 died... 08:06:41.141948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26511): Terminated: ok {rc=0} 08:06:41.227787 bus /sierra_3: Setting Powered False 08:06:42.327105 bus /sierra_3: Setting Powered False 08:06:43.442399 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 emergency:nanobts+band-900 --------------------------------------------------------------------- 08:06:44.694349 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:06:44.699546 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:06:44.730834 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 08:06:44.757229 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 08:06:44.842146 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:06:44.873879 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 08:06:44.899717 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 08:06:45.486921 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2401 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 08:06:45.492558 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:45.503985 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 08:06:45.555785 tst emergency_mo_mt_call.py: using LAC 39553 08:06:45.682184 tst emergency_mo_mt_call.py: using RAC 28 08:06:45.812822 tst emergency_mo_mt_call.py: using CellId 39553 08:06:45.960290 tst emergency_mo_mt_call.py: using BVCI 39554 08:06:46.078533 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:46.090589 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:46.102350 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:46.114179 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:46.126744 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:46.139302 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:06:46.280063 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:06:46.398596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:46.947486 run create_hlr_db(pid=26518): Launched 08:06:47.104104 bus /sierra_2: Setting Powered False 08:06:48.164093 run create_hlr_db(pid=26518): Terminated: ok {rc=0} 08:06:48.614514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26520): Launched 08:06:48.935307 run osmo-hlr_10.42.42.2(pid=26521): Launched 08:06:49.056909 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:49.609634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26523): Launched 08:06:49.930024 run osmo-stp_10.42.42.5(pid=26524): Launched 08:06:50.061386 tst emergency_mo_mt_call.py: using MSISDN 8576 08:06:50.226500 run osmo-msc_10.42.42.6: Starting osmo-msc 08:06:50.803168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26526): Launched 08:06:51.123623 run osmo-msc_10.42.42.6(pid=26527): Launched 08:06:51.302044 run osmo-stp_10.42.42.5(pid=26524): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26524)] 08:06:51.436583 run osmo-stp_10.42.42.5(pid=26524): stdout: | (launched: 2022-12-14_08:06:49.871077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:51.571888 run osmo-stp_10.42.42.5(pid=26524): stderr: | 20221214080650061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080650062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080650062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080650062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080650063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080650063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080650063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:51.706680 run osmo-stp_10.42.42.5(pid=26524): stdout: | (launched: 2022-12-14_08:06:49.871077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:51.834026 run osmo-stp_10.42.42.5(pid=26524): stderr: | 20221214080650061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080650062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080650062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080650062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080650063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080650063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080650063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:51.986634 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26524): Process ended prematurely: osmo-stp_10.42.42.5(pid=26524) [trial-2401↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26524)] [trial-2401↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 08:06:51.996143 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 08:06:52.023810 run osmo-hlr_10.42.42.2(pid=26521): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26521)] 08:06:52.075612 run osmo-hlr_10.42.42.2(pid=26521): stdout: | (launched: 2022-12-14_08:06:48.876620) 08:06:52.128360 run osmo-hlr_10.42.42.2(pid=26521): stderr: | 20221214080649071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080649071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080649071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080649071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080649071 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080649071 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080649083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080649091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080649092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080649092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:52.202146 run osmo-msc_10.42.42.6(pid=26527): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26527)] 08:06:52.251800 run osmo-msc_10.42.42.6(pid=26527): stdout: | (launched: 2022-12-14_08:06:51.064655) 08:06:52.304309 run osmo-msc_10.42.42.6(pid=26527): stderr: | 20221214080651383 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080651383 DLGLOBAL DEBUG validating counter group 0x7fd1db661c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080651383 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080651383 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080651383 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080651383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080651385 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080651386 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080651386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080651386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:06:52.357107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26520): Terminating (SIGTERM) 08:06:52.399497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26523): Terminating (SIGTERM) 08:06:52.441989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26526): Terminating (SIGTERM) 08:06:52.484827 --- ParallelTerminationStrategy: PID 26520 died... 08:06:52.505603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26520): Terminated: ok {rc=0} 08:06:52.552040 --- ParallelTerminationStrategy: PID 26523 died... 08:06:52.572264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26523): Terminated: ok {rc=0} 08:06:52.618549 --- ParallelTerminationStrategy: PID 26526 died... 08:06:52.638700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26526): Terminated: ok {rc=0} 08:06:52.727542 bus /sierra_3: Setting Powered False 08:06:53.825906 bus /sierra_3: Setting Powered False 08:06:54.941833 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 08:06:56.026235 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:56.037883 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 08:06:56.087154 tst emergency_preemptive_call.py: using LAC 39554 08:06:56.204560 tst emergency_preemptive_call.py: using RAC 29 08:06:56.330565 tst emergency_preemptive_call.py: using CellId 39554 08:06:56.456242 tst emergency_preemptive_call.py: using BVCI 39555 08:06:56.572527 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:56.584088 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:56.595312 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:56.606354 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:56.617775 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:06:56.629068 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:06:56.746264 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:06:56.866765 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:06:56.988001 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:06:57.103932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:57.567753 run create_hlr_db(pid=26529): Launched 08:06:57.693185 bus /sierra_2: Setting Powered False 08:06:58.756525 run create_hlr_db(pid=26529): Terminated: ok {rc=0} 08:06:59.204250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26531): Launched 08:06:59.526485 run osmo-hlr_10.42.42.2(pid=26532): Launched 08:06:59.649469 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:00.203012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26534): Launched 08:07:00.524809 run osmo-stp_10.42.42.5(pid=26535): Launched 08:07:00.661679 tst emergency_preemptive_call.py: using MSISDN 8577 08:07:00.830739 run osmo-msc_10.42.42.6: Starting osmo-msc 08:07:01.430603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26537): Launched 08:07:01.769748 run osmo-msc_10.42.42.6(pid=26538): Launched 08:07:02.141113 run osmo-stp_10.42.42.5(pid=26535): ERR: Terminated: ERROR {rc=1} [trial-2401↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26535)] 08:07:02.292631 run osmo-stp_10.42.42.5(pid=26535): stdout: | (launched: 2022-12-14_08:07:00.465630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:02.428632 run osmo-stp_10.42.42.5(pid=26535): stderr: | 20221214080700655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080700655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080700655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080700656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080700656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080700656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080700656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:02.563294 run osmo-stp_10.42.42.5(pid=26535): stdout: | (launched: 2022-12-14_08:07:00.465630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:02.690631 run osmo-stp_10.42.42.5(pid=26535): stderr: | 20221214080700655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080700655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080700655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080700656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080700656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080700656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080700656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:02.843082 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26535): Process ended prematurely: osmo-stp_10.42.42.5(pid=26535) [trial-2401↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26535)] [trial-2401↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 08:07:02.852202 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 08:07:02.880143 run osmo-hlr_10.42.42.2(pid=26532): ERR: Terminated: ERROR {rc=237} [trial-2401↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26532)] 08:07:02.931376 run osmo-hlr_10.42.42.2(pid=26532): stdout: | (launched: 2022-12-14_08:06:59.466660) 08:07:02.984061 run osmo-hlr_10.42.42.2(pid=26532): stderr: | 20221214080659663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080659663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080659663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080659663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080659663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080659663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080659676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080659684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080659684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080659684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:03.057405 run osmo-msc_10.42.42.6(pid=26538): ERR: Terminated: ERROR {rc=2} [trial-2401↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26538)] 08:07:03.107210 run osmo-msc_10.42.42.6(pid=26538): stdout: | (launched: 2022-12-14_08:07:01.708578) 08:07:03.160064 run osmo-msc_10.42.42.6(pid=26538): stderr: | 20221214080702144 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214080702145 DLGLOBAL DEBUG validating counter group 0x7f4e20daac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214080702145 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214080702145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214080702145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214080702145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214080702147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214080702147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214080702148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214080702148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:07:03.212754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26531): Terminating (SIGTERM) 08:07:03.254919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26534): Terminating (SIGTERM) 08:07:03.297857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26537): Terminating (SIGTERM) 08:07:03.340666 --- ParallelTerminationStrategy: PID 26531 died... 08:07:03.361411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26531): Terminated: ok {rc=0} 08:07:03.408308 --- ParallelTerminationStrategy: PID 26534 died... 08:07:03.428215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26534): Terminated: ok {rc=0} 08:07:03.475258 --- ParallelTerminationStrategy: PID 26537 died... 08:07:03.495796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26537): Terminated: ok {rc=0} 08:07:03.583723 bus /sierra_9: Setting Powered False 08:07:04.683309 bus /sierra_9: Setting Powered False 08:07:05.799484 bus /sierra_8: Setting Powered False 08:07:06.897574 bus /sierra_8: Setting Powered False 08:07:08.012681 bus /sierra_3: Setting Powered False 08:07:09.109624 bus /sierra_3: Setting Powered False 08:07:10.225975 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-900 --------------------------------------------------------------------- 08:07:11.501550 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:07:11.507375 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:07:11.539935 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 08:07:11.579832 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 08:07:11.667359 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:07:11.700035 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 08:07:11.739148 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 08:07:12.331584 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 08:07:12.385602 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:12.396621 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:07:12.444779 tst cs_paging_gprs_active.py: using LAC 39555 08:07:12.573280 tst cs_paging_gprs_active.py: using RAC 30 08:07:12.700387 tst cs_paging_gprs_active.py: using CellId 39555 08:07:12.830050 tst cs_paging_gprs_active.py: using BVCI 39556 08:07:12.949218 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:12.960415 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:12.971388 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:12.982323 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:12.993664 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:13.004816 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:13.016192 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:13.027319 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:13.038719 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:07:13.157112 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:07:13.276107 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:07:13.480060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:13.785692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26543): Launched 08:07:14.053108 run iperf3-srv_10.42.42.10(pid=26544): Launched 08:07:14.168027 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:07:14.372070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:14.677716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26545): Launched 08:07:14.943251 run iperf3-srv_10.42.42.10(pid=26546): Launched 08:07:15.057865 tst cs_paging_gprs_active.py:38: start network... 08:07:15.261008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:15.731493 run create_hlr_db(pid=26547): Launched 08:07:15.871799 bus /sierra_2: Setting Powered False 08:07:16.941783 run create_hlr_db(pid=26547): Terminated: ok {rc=0} 08:07:17.437043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26549): Launched 08:07:17.742921 run osmo-hlr_10.42.42.2(pid=26550): Launched 08:07:17.858718 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:18.380185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26552): Launched 08:07:18.685994 run osmo-stp_10.42.42.5(pid=26553): Launched 08:07:18.802252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:19.325186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26555): Launched 08:07:19.442757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:19.699582 run patchelf(pid=26556): Launched 08:07:19.870456 run osmo-stp_10.42.42.5(pid=26553): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26553)] 08:07:19.998689 run osmo-stp_10.42.42.5(pid=26553): stdout: | (launched: 2022-12-14_08:07:18.629500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:20.128168 run osmo-stp_10.42.42.5(pid=26553): stderr: | 20221214080718798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080718798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080718798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080718799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080718799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080718799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080718799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:20.257544 run osmo-stp_10.42.42.5(pid=26553): stdout: | (launched: 2022-12-14_08:07:18.629500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:20.381291 run osmo-stp_10.42.42.5(pid=26553): stderr: | 20221214080718798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080718798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080718798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080718799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080718799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080718799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080718799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:20.528155 run patchelf(pid=26556): Terminating (SIGINT) 08:07:20.700148 run patchelf(pid=26556): Terminated: ok {rc=0} 08:07:20.834746 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26553): Process ended prematurely: osmo-stp_10.42.42.5(pid=26553) [trial-2401↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26553)] [trial-2401↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 08:07:20.844113 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 08:07:20.871085 run osmo-hlr_10.42.42.2(pid=26550): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26550)] 08:07:20.918014 run osmo-hlr_10.42.42.2(pid=26550): stdout: | (launched: 2022-12-14_08:07:17.685916) 08:07:20.966796 run osmo-hlr_10.42.42.2(pid=26550): stderr: | 20221214080717860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080717860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080717860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080717860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080717861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080717861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080717873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080717881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080717881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080717882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:21.015861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26543): Terminating (SIGTERM) 08:07:21.055272 run iperf3-srv_10.42.42.10(pid=26544): Terminating (SIGTERM) 08:07:21.094474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26545): Terminating (SIGTERM) 08:07:21.133756 run iperf3-srv_10.42.42.10(pid=26546): Terminating (SIGTERM) 08:07:21.172728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26549): Terminating (SIGTERM) 08:07:21.211891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26552): Terminating (SIGTERM) 08:07:21.250978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26555): Terminating (SIGTERM) 08:07:21.290544 --- ParallelTerminationStrategy: PID 26543 died... 08:07:21.308860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26543): Terminated: ok {rc=0} 08:07:21.352598 --- ParallelTerminationStrategy: PID 26544 died... 08:07:21.370994 run iperf3-srv_10.42.42.10(pid=26544): Terminated {rc=256} 08:07:21.414114 --- ParallelTerminationStrategy: PID 26545 died... 08:07:21.432437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26545): Terminated: ok {rc=0} 08:07:21.475454 --- ParallelTerminationStrategy: PID 26546 died... 08:07:21.493671 run iperf3-srv_10.42.42.10(pid=26546): Terminated {rc=256} 08:07:21.536681 --- ParallelTerminationStrategy: PID 26549 died... 08:07:21.555057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26549): Terminated: ok {rc=0} 08:07:21.598132 --- ParallelTerminationStrategy: PID 26552 died... 08:07:21.616574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26552): Terminated: ok {rc=0} 08:07:21.659817 --- ParallelTerminationStrategy: PID 26555 died... 08:07:21.678294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26555): Terminated: ok {rc=0} 08:07:21.764797 bus /gobi_0: Setting Powered False 08:07:22.864287 bus /gobi_0: Setting Powered False 08:07:23.982279 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 08:07:25.127773 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:25.139065 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:07:25.189407 tst iperf3.py: using LAC 39556 08:07:25.317339 tst iperf3.py: using RAC 31 08:07:25.447875 tst iperf3.py: using CellId 39556 08:07:25.569069 tst iperf3.py: using BVCI 39557 08:07:25.680923 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:25.691722 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:25.702719 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:25.713185 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:25.723444 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:25.734347 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:25.745309 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:25.756060 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:25.766628 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:07:25.886580 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:07:26.108310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:26.437444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26557): Launched 08:07:26.724576 run iperf3-srv_10.42.42.10(pid=26558): Launched 08:07:26.847373 tst iperf3.py:8: start network... 08:07:27.067047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:27.573790 run create_hlr_db(pid=26559): Launched 08:07:27.701666 bus /gobi_6: Setting Powered False 08:07:28.766202 run create_hlr_db(pid=26559): Terminated: ok {rc=0} 08:07:29.204683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26561): Launched 08:07:29.511720 run osmo-hlr_10.42.42.2(pid=26562): Launched 08:07:29.629111 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:30.169268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26564): Launched 08:07:30.474722 run osmo-stp_10.42.42.5(pid=26565): Launched 08:07:30.590866 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:31.166283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26567): Launched 08:07:31.303494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:31.589105 run patchelf(pid=26568): Launched 08:07:31.791174 run osmo-stp_10.42.42.5(pid=26565): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26565)] 08:07:31.935987 run osmo-stp_10.42.42.5(pid=26565): stdout: | (launched: 2022-12-14_08:07:30.418266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:32.081175 run osmo-stp_10.42.42.5(pid=26565): stderr: | 20221214080730587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080730587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080730587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080730587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080730588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080730588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080730588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:32.225397 run osmo-stp_10.42.42.5(pid=26565): stdout: | (launched: 2022-12-14_08:07:30.418266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:32.359573 run osmo-stp_10.42.42.5(pid=26565): stderr: | 20221214080730587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080730587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080730587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080730587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080730588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080730588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080730588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:32.519295 run patchelf(pid=26568): Terminating (SIGINT) 08:07:32.704197 run patchelf(pid=26568): Terminated: ok {rc=0} 08:07:32.837568 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26565): Process ended prematurely: osmo-stp_10.42.42.5(pid=26565) [trial-2401↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26565)] [trial-2401↪gprs:nanobts+band-900↪iperf3.py:8] 08:07:32.847954 tst iperf3.py:8: Test FAILED (7.8 sec) 08:07:32.877085 run osmo-hlr_10.42.42.2(pid=26562): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26562)] 08:07:32.928313 run osmo-hlr_10.42.42.2(pid=26562): stdout: | (launched: 2022-12-14_08:07:29.455326) 08:07:32.981266 run osmo-hlr_10.42.42.2(pid=26562): stderr: | 20221214080729631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080729631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080729631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080729631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080729631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080729631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080729642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080729650 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080729650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080729651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:33.033895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26557): Terminating (SIGTERM) 08:07:33.076393 run iperf3-srv_10.42.42.10(pid=26558): Terminating (SIGTERM) 08:07:33.119272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26561): Terminating (SIGTERM) 08:07:33.162116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26564): Terminating (SIGTERM) 08:07:33.204587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26567): Terminating (SIGTERM) 08:07:33.247390 --- ParallelTerminationStrategy: PID 26557 died... 08:07:33.268140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26557): Terminated: ok {rc=0} 08:07:33.315100 --- ParallelTerminationStrategy: PID 26558 died... 08:07:33.335304 run iperf3-srv_10.42.42.10(pid=26558): Terminated {rc=256} 08:07:33.382023 --- ParallelTerminationStrategy: PID 26561 died... 08:07:33.402090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26561): Terminated: ok {rc=0} 08:07:33.448600 --- ParallelTerminationStrategy: PID 26564 died... 08:07:33.468550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26564): Terminated: ok {rc=0} 08:07:33.515684 --- ParallelTerminationStrategy: PID 26567 died... 08:07:33.535829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26567): Terminated: ok {rc=0} 08:07:33.625475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 08:07:34.776110 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:34.788078 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:07:34.841455 tst iperf3m4.py: using LAC 39557 08:07:34.966050 tst iperf3m4.py: using RAC 32 08:07:35.084720 tst iperf3m4.py: using CellId 39557 08:07:35.202375 tst iperf3m4.py: using BVCI 39558 08:07:35.314018 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:35.324685 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:35.335254 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:35.345766 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:35.356153 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:35.367148 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:35.378276 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:35.388752 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:35.399482 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:07:35.520796 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:07:35.639509 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:07:35.760901 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:07:35.883060 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:07:36.104157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:36.433218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26569): Launched 08:07:36.719507 run iperf3-srv_10.42.42.10(pid=26570): Launched 08:07:36.834807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:07:37.038065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:37.344316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26571): Launched 08:07:37.612144 run iperf3-srv_10.42.42.10(pid=26572): Launched 08:07:37.726398 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:07:37.929746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:38.235158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26573): Launched 08:07:38.500142 run iperf3-srv_10.42.42.10(pid=26574): Launched 08:07:38.613945 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:07:38.816252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:07:39.121107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Launched 08:07:39.386199 run iperf3-srv_10.42.42.10(pid=26576): Launched 08:07:39.499937 tst iperf3m4.py:8: start network... 08:07:39.702709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:40.174594 run create_hlr_db(pid=26577): Launched 08:07:40.299272 bus /gobi_6: Setting Powered False 08:07:41.359300 run create_hlr_db(pid=26577): Terminated: ok {rc=0} 08:07:41.782321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26579): Launched 08:07:42.088767 run osmo-hlr_10.42.42.2(pid=26580): Launched 08:07:42.204655 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:42.728707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26582): Launched 08:07:43.034445 run osmo-stp_10.42.42.5(pid=26583): Launched 08:07:43.150919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:43.674040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26585): Launched 08:07:43.790818 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:44.048505 run patchelf(pid=26586): Launched 08:07:44.218271 run osmo-stp_10.42.42.5(pid=26583): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26583)] 08:07:44.346471 run osmo-stp_10.42.42.5(pid=26583): stdout: | (launched: 2022-12-14_08:07:42.977665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:44.476128 run osmo-stp_10.42.42.5(pid=26583): stderr: | 20221214080743144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080743144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080743144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080743145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080743145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080743146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080743146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:44.605834 run osmo-stp_10.42.42.5(pid=26583): stdout: | (launched: 2022-12-14_08:07:42.977665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:44.729369 run osmo-stp_10.42.42.5(pid=26583): stderr: | 20221214080743144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080743144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080743144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080743145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080743145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080743146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080743146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:44.876635 run patchelf(pid=26586): Terminating (SIGINT) 08:07:45.049541 run patchelf(pid=26586): Terminated: ok {rc=0} 08:07:45.173796 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26583): Process ended prematurely: osmo-stp_10.42.42.5(pid=26583) [trial-2401↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26583)] [trial-2401↪gprs:nanobts+band-900↪iperf3m4.py:8] 08:07:45.183394 tst iperf3m4.py:8: Test FAILED (10.4 sec) 08:07:45.210972 run osmo-hlr_10.42.42.2(pid=26580): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26580)] 08:07:45.258424 run osmo-hlr_10.42.42.2(pid=26580): stdout: | (launched: 2022-12-14_08:07:42.031949) 08:07:45.307664 run osmo-hlr_10.42.42.2(pid=26580): stderr: | 20221214080742205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080742205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080742205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080742205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080742205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080742205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080742219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080742227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080742228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080742228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:45.357322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26569): Terminating (SIGTERM) 08:07:45.396770 run iperf3-srv_10.42.42.10(pid=26570): Terminating (SIGTERM) 08:07:45.436374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26571): Terminating (SIGTERM) 08:07:45.475820 run iperf3-srv_10.42.42.10(pid=26572): Terminating (SIGTERM) 08:07:45.515140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26573): Terminating (SIGTERM) 08:07:45.554645 run iperf3-srv_10.42.42.10(pid=26574): Terminating (SIGTERM) 08:07:45.593942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Terminating (SIGTERM) 08:07:45.633256 run iperf3-srv_10.42.42.10(pid=26576): Terminating (SIGTERM) 08:07:45.672661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26579): Terminating (SIGTERM) 08:07:45.712180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26582): Terminating (SIGTERM) 08:07:45.751662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26585): Terminating (SIGTERM) 08:07:45.791531 --- ParallelTerminationStrategy: PID 26569 died... 08:07:45.810973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26569): Terminated: ok {rc=0} 08:07:45.876557 --- ParallelTerminationStrategy: PID 26570 died... 08:07:45.898248 run iperf3-srv_10.42.42.10(pid=26570): Terminated {rc=256} 08:07:45.948329 --- ParallelTerminationStrategy: PID 26571 died... 08:07:45.967849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26571): Terminated: ok {rc=0} 08:07:46.020067 --- ParallelTerminationStrategy: PID 26572 died... 08:07:46.039594 run iperf3-srv_10.42.42.10(pid=26572): Terminated {rc=256} 08:07:46.084364 --- ParallelTerminationStrategy: PID 26573 died... 08:07:46.103875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26573): Terminated: ok {rc=0} 08:07:46.148553 --- ParallelTerminationStrategy: PID 26574 died... 08:07:46.168046 run iperf3-srv_10.42.42.10(pid=26574): Terminated {rc=256} 08:07:46.212889 --- ParallelTerminationStrategy: PID 26575 died... 08:07:46.232240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26575): Terminated: ok {rc=0} 08:07:46.276583 --- ParallelTerminationStrategy: PID 26576 died... 08:07:46.296071 run iperf3-srv_10.42.42.10(pid=26576): Terminated {rc=256} 08:07:46.340363 --- ParallelTerminationStrategy: PID 26579 died... 08:07:46.359688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26579): Terminated: ok {rc=0} 08:07:46.404330 --- ParallelTerminationStrategy: PID 26582 died... 08:07:46.423825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26582): Terminated: ok {rc=0} 08:07:46.468306 --- ParallelTerminationStrategy: PID 26585 died... 08:07:46.487868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26585): Terminated: ok {rc=0} 08:07:46.581310 bus /gobi_4: Setting Powered False 08:07:47.695401 bus /gobi_4: Setting Powered False 08:07:48.811310 bus /gobi_1: Setting Powered False 08:07:49.910170 bus /gobi_1: Setting Powered False 08:07:51.025520 bus /gobi_0: Setting Powered False 08:07:52.121690 bus /gobi_0: Setting Powered False 08:07:53.234616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900 ping.py ---------------------------------------------- 08:07:54.337415 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:54.349342 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:07:54.397980 tst ping.py: using LAC 39558 08:07:54.525548 tst ping.py: using RAC 33 08:07:54.652767 tst ping.py: using CellId 39558 08:07:54.778085 tst ping.py: using BVCI 39559 08:07:54.896012 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:54.907294 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:54.918414 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:54.929409 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:54.940656 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:54.951924 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:54.963396 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:07:54.974765 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:07:55.091087 tst ping.py:19: start network... 08:07:55.293615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:55.757905 run create_hlr_db(pid=26587): Launched 08:07:55.881858 bus /gobi_6: Setting Powered False 08:07:56.941501 run create_hlr_db(pid=26587): Terminated: ok {rc=0} 08:07:57.380892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26589): Launched 08:07:57.702397 run osmo-hlr_10.42.42.2(pid=26590): Launched 08:07:57.822925 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:58.381508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26592): Launched 08:07:58.705185 run osmo-stp_10.42.42.5(pid=26593): Launched 08:07:58.827124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:59.379179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26595): Launched 08:07:59.503537 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:59.775121 run patchelf(pid=26596): Launched 08:07:59.954432 run osmo-stp_10.42.42.5(pid=26593): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26593)] 08:08:00.090666 run osmo-stp_10.42.42.5(pid=26593): stdout: | (launched: 2022-12-14_08:07:58.645716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:00.228135 run osmo-stp_10.42.42.5(pid=26593): stderr: | 20221214080758837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080758837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080758837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080758838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080758838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080758838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080758838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:00.366594 run osmo-stp_10.42.42.5(pid=26593): stdout: | (launched: 2022-12-14_08:07:58.645716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:00.497977 run osmo-stp_10.42.42.5(pid=26593): stderr: | 20221214080758837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080758837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080758837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080758838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080758838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080758838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080758838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:00.653614 run patchelf(pid=26596): Terminating (SIGINT) 08:08:00.834751 run patchelf(pid=26596): Terminated: ok {rc=0} 08:08:00.990728 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26593): Process ended prematurely: osmo-stp_10.42.42.5(pid=26593) [trial-2401↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26593)] [trial-2401↪gprs:nanobts+band-900↪ping.py:22] 08:08:01.001381 tst ping.py:22: Test FAILED (6.7 sec) 08:08:01.030954 run osmo-hlr_10.42.42.2(pid=26590): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26590)] 08:08:01.085496 run osmo-hlr_10.42.42.2(pid=26590): stdout: | (launched: 2022-12-14_08:07:57.643516) 08:08:01.139582 run osmo-hlr_10.42.42.2(pid=26590): stderr: | 20221214080757839 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080757839 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080757839 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080757839 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080757840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080757840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080757851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080757859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080757860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080757860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:01.194456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26589): Terminating (SIGTERM) 08:08:01.237682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26592): Terminating (SIGTERM) 08:08:01.281726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26595): Terminating (SIGTERM) 08:08:01.325983 --- ParallelTerminationStrategy: PID 26589 died... 08:08:01.347984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26589): Terminated: ok {rc=0} 08:08:01.396393 --- ParallelTerminationStrategy: PID 26592 died... 08:08:01.418349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26592): Terminated: ok {rc=0} 08:08:01.466978 --- ParallelTerminationStrategy: PID 26595 died... 08:08:01.488632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26595): Terminated: ok {rc=0} 08:08:01.587575 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 08:08:02.683051 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:08:02.694681 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:08:02.743558 tst ping_idle_ping.py: using LAC 39559 08:08:02.870751 tst ping_idle_ping.py: using RAC 34 08:08:02.998492 tst ping_idle_ping.py: using CellId 39559 08:08:03.129947 tst ping_idle_ping.py: using BVCI 39560 08:08:03.247368 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:08:03.258842 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:08:03.270188 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:08:03.281548 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:08:03.293094 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:08:03.304448 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:08:03.316043 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:08:03.327576 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:08:03.444678 tst ping_idle_ping.py:24: start network... 08:08:03.646389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:04.114231 run create_hlr_db(pid=26597): Launched 08:08:04.237794 bus /gobi_6: Setting Powered False 08:08:05.298400 run create_hlr_db(pid=26597): Terminated: ok {rc=0} 08:08:05.739732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26599): Launched 08:08:06.062418 run osmo-hlr_10.42.42.2(pid=26600): Launched 08:08:06.185196 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:06.745214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26602): Launched 08:08:07.067674 run osmo-stp_10.42.42.5(pid=26603): Launched 08:08:07.189335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:07.743050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26605): Launched 08:08:07.866339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:08.137860 run patchelf(pid=26606): Launched 08:08:08.318283 run osmo-stp_10.42.42.5(pid=26603): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26603)] 08:08:08.454970 run osmo-stp_10.42.42.5(pid=26603): stdout: | (launched: 2022-12-14_08:08:07.008297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:08.594209 run osmo-stp_10.42.42.5(pid=26603): stderr: | 20221214080807196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080807196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080807196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080807197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080807197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080807197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080807197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:08.732491 run osmo-stp_10.42.42.5(pid=26603): stdout: | (launched: 2022-12-14_08:08:07.008297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:08.864153 run osmo-stp_10.42.42.5(pid=26603): stderr: | 20221214080807196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080807196 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080807196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080807197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080807197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080807197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080807197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:09.020390 run patchelf(pid=26606): Terminating (SIGINT) 08:08:09.203577 run patchelf(pid=26606): Terminated: ok {rc=0} 08:08:09.335600 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26603): Process ended prematurely: osmo-stp_10.42.42.5(pid=26603) [trial-2401↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26603)] [trial-2401↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 08:08:09.345151 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:08:09.373677 run osmo-hlr_10.42.42.2(pid=26600): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26600)] 08:08:09.424496 run osmo-hlr_10.42.42.2(pid=26600): stdout: | (launched: 2022-12-14_08:08:06.003234) 08:08:09.477140 run osmo-hlr_10.42.42.2(pid=26600): stderr: | 20221214080806197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080806197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080806197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080806198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080806198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080806198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080806210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080806221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080806221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080806221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:09.530092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26599): Terminating (SIGTERM) 08:08:09.572355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26602): Terminating (SIGTERM) 08:08:09.615345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26605): Terminating (SIGTERM) 08:08:09.658220 --- ParallelTerminationStrategy: PID 26599 died... 08:08:09.678996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26599): Terminated: ok {rc=0} 08:08:09.725946 --- ParallelTerminationStrategy: PID 26602 died... 08:08:09.746088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26602): Terminated: ok {rc=0} 08:08:09.792794 --- ParallelTerminationStrategy: PID 26605 died... 08:08:09.813508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26605): Terminated: ok {rc=0} 08:08:09.902289 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 08:08:11.207526 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:08:11.214646 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:08:11.247487 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:08:11.287715 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:08:11.374832 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:08:11.407695 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:08:11.447143 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:08:12.050766 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:08:12.104146 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:12.115727 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:08:12.169496 tst cs_paging_gprs_active.py: using LAC 39560 08:08:12.289354 tst cs_paging_gprs_active.py: using RAC 35 08:08:12.408315 tst cs_paging_gprs_active.py: using CellId 39560 08:08:12.526493 tst cs_paging_gprs_active.py: using BVCI 39561 08:08:12.636784 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:12.648096 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:12.658861 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:12.669786 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:12.680360 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:12.691173 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:12.701990 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:12.712548 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:12.723425 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:08:12.841692 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:08:12.964048 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:08:13.185967 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:13.515338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26610): Launched 08:08:13.803364 run iperf3-srv_10.42.42.10(pid=26611): Launched 08:08:13.926572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:08:14.146829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:14.475307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26612): Launched 08:08:14.760484 run iperf3-srv_10.42.42.10(pid=26613): Launched 08:08:14.885101 tst cs_paging_gprs_active.py:38: start network... 08:08:15.104918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:15.611650 run create_hlr_db(pid=26614): Launched 08:08:15.737178 bus /gobi_6: Setting Powered False 08:08:16.800857 run create_hlr_db(pid=26614): Terminated: ok {rc=0} 08:08:17.269991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26616): Launched 08:08:17.587583 run osmo-hlr_10.42.42.2(pid=26617): Launched 08:08:17.704382 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:18.231593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26619): Launched 08:08:18.537383 run osmo-stp_10.42.42.5(pid=26620): Launched 08:08:18.654723 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:19.184483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26622): Launched 08:08:19.302029 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:19.560170 run patchelf(pid=26623): Launched 08:08:19.730688 run osmo-stp_10.42.42.5(pid=26620): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26620)] 08:08:19.860007 run osmo-stp_10.42.42.5(pid=26620): stdout: | (launched: 2022-12-14_08:08:18.480692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:19.990219 run osmo-stp_10.42.42.5(pid=26620): stderr: | 20221214080818649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080818649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080818650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080818650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080818651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080818651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080818651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:20.120522 run osmo-stp_10.42.42.5(pid=26620): stdout: | (launched: 2022-12-14_08:08:18.480692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:20.246308 run osmo-stp_10.42.42.5(pid=26620): stderr: | 20221214080818649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080818649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080818650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080818650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080818651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080818651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080818651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:20.394323 run patchelf(pid=26623): Terminating (SIGINT) 08:08:20.566963 run patchelf(pid=26623): Terminated: ok {rc=0} 08:08:20.691476 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26620): Process ended prematurely: osmo-stp_10.42.42.5(pid=26620) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26620)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:08:20.701104 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:08:20.728184 run osmo-hlr_10.42.42.2(pid=26617): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26617)] 08:08:20.775617 run osmo-hlr_10.42.42.2(pid=26617): stdout: | (launched: 2022-12-14_08:08:17.530686) 08:08:20.824845 run osmo-hlr_10.42.42.2(pid=26617): stderr: | 20221214080817704 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080817704 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080817704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080817704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080817705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080817705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080817719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080817729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080817729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080817730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:20.874573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26610): Terminating (SIGTERM) 08:08:20.914629 run iperf3-srv_10.42.42.10(pid=26611): Terminating (SIGTERM) 08:08:20.954390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26612): Terminating (SIGTERM) 08:08:20.994209 run iperf3-srv_10.42.42.10(pid=26613): Terminating (SIGTERM) 08:08:21.033848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26616): Terminating (SIGTERM) 08:08:21.073529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26619): Terminating (SIGTERM) 08:08:21.113237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26622): Terminating (SIGTERM) 08:08:21.153261 --- ParallelTerminationStrategy: PID 26610 died... 08:08:21.172526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26610): Terminated: ok {rc=0} 08:08:21.216405 --- ParallelTerminationStrategy: PID 26611 died... 08:08:21.235199 run iperf3-srv_10.42.42.10(pid=26611): Terminated {rc=256} 08:08:21.278728 --- ParallelTerminationStrategy: PID 26612 died... 08:08:21.297705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26612): Terminated: ok {rc=0} 08:08:21.341383 --- ParallelTerminationStrategy: PID 26613 died... 08:08:21.360102 run iperf3-srv_10.42.42.10(pid=26613): Terminated {rc=256} 08:08:21.403807 --- ParallelTerminationStrategy: PID 26616 died... 08:08:21.422747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26616): Terminated: ok {rc=0} 08:08:21.466531 --- ParallelTerminationStrategy: PID 26619 died... 08:08:21.485403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26619): Terminated: ok {rc=0} 08:08:21.529302 --- ParallelTerminationStrategy: PID 26622 died... 08:08:21.548057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26622): Terminated: ok {rc=0} 08:08:21.633592 bus /gobi_0: Setting Powered False 08:08:22.733335 bus /gobi_0: Setting Powered False 08:08:23.847732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:08:24.992841 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:25.004579 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:08:25.056835 tst iperf3.py: using LAC 39561 08:08:25.176705 tst iperf3.py: using RAC 36 08:08:25.296331 tst iperf3.py: using CellId 39561 08:08:25.417898 tst iperf3.py: using BVCI 39562 08:08:25.529252 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:25.540206 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:25.550920 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:25.561713 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:25.572499 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:25.583457 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:25.594505 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:25.605290 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:25.616277 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:08:25.731949 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:08:25.938034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:26.245351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26624): Launched 08:08:26.512583 run iperf3-srv_10.42.42.10(pid=26625): Launched 08:08:26.627437 tst iperf3.py:8: start network... 08:08:26.831113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:27.303478 run create_hlr_db(pid=26626): Launched 08:08:27.427775 bus /gobi_6: Setting Powered False 08:08:28.488080 run create_hlr_db(pid=26626): Terminated: ok {rc=0} 08:08:28.934869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26628): Launched 08:08:29.263509 run osmo-hlr_10.42.42.2(pid=26629): Launched 08:08:29.388699 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:29.956100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26631): Launched 08:08:30.283437 run osmo-stp_10.42.42.5(pid=26632): Launched 08:08:30.408150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:31.001832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26634): Launched 08:08:31.132352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:31.400371 run patchelf(pid=26635): Launched 08:08:31.589657 run osmo-stp_10.42.42.5(pid=26632): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26632)] 08:08:31.723338 run osmo-stp_10.42.42.5(pid=26632): stdout: | (launched: 2022-12-14_08:08:30.223367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:31.871726 run osmo-stp_10.42.42.5(pid=26632): stderr: | 20221214080830412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080830412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080830412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080830412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080830413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080830413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080830413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:32.007102 run osmo-stp_10.42.42.5(pid=26632): stdout: | (launched: 2022-12-14_08:08:30.223367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:32.134436 run osmo-stp_10.42.42.5(pid=26632): stderr: | 20221214080830412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080830412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080830412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080830412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080830413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080830413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080830413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:32.283842 run patchelf(pid=26635): Terminating (SIGINT) 08:08:32.457781 run patchelf(pid=26635): Terminated: ok {rc=0} 08:08:32.582302 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26632): Process ended prematurely: osmo-stp_10.42.42.5(pid=26632) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26632)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 08:08:32.591940 tst iperf3.py:8: Test FAILED (7.6 sec) 08:08:32.619566 run osmo-hlr_10.42.42.2(pid=26629): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26629)] 08:08:32.667882 run osmo-hlr_10.42.42.2(pid=26629): stdout: | (launched: 2022-12-14_08:08:29.203433) 08:08:32.717576 run osmo-hlr_10.42.42.2(pid=26629): stderr: | 20221214080829397 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080829397 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080829397 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080829397 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080829397 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080829397 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080829408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080829417 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080829417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080829418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:32.767320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26624): Terminating (SIGTERM) 08:08:32.807324 run iperf3-srv_10.42.42.10(pid=26625): Terminating (SIGTERM) 08:08:32.847342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26628): Terminating (SIGTERM) 08:08:32.887024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26631): Terminating (SIGTERM) 08:08:32.926449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26634): Terminating (SIGTERM) 08:08:32.966826 --- ParallelTerminationStrategy: PID 26624 died... 08:08:32.985984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26624): Terminated: ok {rc=0} 08:08:33.029991 --- ParallelTerminationStrategy: PID 26625 died... 08:08:33.048673 run iperf3-srv_10.42.42.10(pid=26625): Terminated {rc=256} 08:08:33.092555 --- ParallelTerminationStrategy: PID 26628 died... 08:08:33.111603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26628): Terminated: ok {rc=0} 08:08:33.155495 --- ParallelTerminationStrategy: PID 26631 died... 08:08:33.174083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26631): Terminated: ok {rc=0} 08:08:33.217995 --- ParallelTerminationStrategy: PID 26634 died... 08:08:33.237282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26634): Terminated: ok {rc=0} 08:08:33.321248 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:08:34.471525 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:34.483986 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:08:34.535070 tst iperf3m4.py: using LAC 39562 08:08:34.654866 tst iperf3m4.py: using RAC 37 08:08:34.775594 tst iperf3m4.py: using CellId 39562 08:08:34.894508 tst iperf3m4.py: using BVCI 39563 08:08:35.007233 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:35.018425 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:35.029801 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:35.040584 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:35.051442 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:35.062351 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:35.073404 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:35.084151 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:35.095107 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:08:35.211055 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:08:35.333389 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:08:35.451716 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:08:35.574107 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:08:35.795011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:36.123194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26636): Launched 08:08:36.411159 run iperf3-srv_10.42.42.10(pid=26637): Launched 08:08:36.534693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:08:36.755020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:37.082786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26638): Launched 08:08:37.367944 run iperf3-srv_10.42.42.10(pid=26639): Launched 08:08:37.491131 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:08:37.711618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:38.039215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26640): Launched 08:08:38.324675 run iperf3-srv_10.42.42.10(pid=26641): Launched 08:08:38.447848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:08:38.668786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:08:38.997175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26642): Launched 08:08:39.282632 run iperf3-srv_10.42.42.10(pid=26643): Launched 08:08:39.405782 tst iperf3m4.py:8: start network... 08:08:39.626753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:40.133319 run create_hlr_db(pid=26644): Launched 08:08:40.258344 bus /gobi_6: Setting Powered False 08:08:41.323085 run create_hlr_db(pid=26644): Terminated: ok {rc=0} 08:08:41.759504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26646): Launched 08:08:42.067520 run osmo-hlr_10.42.42.2(pid=26647): Launched 08:08:42.183884 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:42.750952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26649): Launched 08:08:43.079772 run osmo-stp_10.42.42.5(pid=26650): Launched 08:08:43.204641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:43.768172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26652): Launched 08:08:43.894584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:44.170582 run patchelf(pid=26653): Launched 08:08:44.352743 run osmo-stp_10.42.42.5(pid=26650): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26650)] 08:08:44.491185 run osmo-stp_10.42.42.5(pid=26650): stdout: | (launched: 2022-12-14_08:08:43.019435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:44.631418 run osmo-stp_10.42.42.5(pid=26650): stderr: | 20221214080843209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080843209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080843209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080843209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080843210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080843210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080843210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:44.771138 run osmo-stp_10.42.42.5(pid=26650): stdout: | (launched: 2022-12-14_08:08:43.019435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:44.904361 run osmo-stp_10.42.42.5(pid=26650): stderr: | 20221214080843209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080843209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080843209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080843209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080843210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080843210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080843210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:45.062458 run patchelf(pid=26653): Terminating (SIGINT) 08:08:45.246689 run patchelf(pid=26653): Terminated: ok {rc=0} 08:08:45.379978 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26650): Process ended prematurely: osmo-stp_10.42.42.5(pid=26650) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26650)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 08:08:45.390287 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:08:45.419185 run osmo-hlr_10.42.42.2(pid=26647): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26647)] 08:08:45.469758 run osmo-hlr_10.42.42.2(pid=26647): stdout: | (launched: 2022-12-14_08:08:42.010762) 08:08:45.521755 run osmo-hlr_10.42.42.2(pid=26647): stderr: | 20221214080842184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080842184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080842184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080842184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080842184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080842184 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080842195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080842203 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080842203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080842203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:45.575594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26636): Terminating (SIGTERM) 08:08:45.617593 run iperf3-srv_10.42.42.10(pid=26637): Terminating (SIGTERM) 08:08:45.659241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26638): Terminating (SIGTERM) 08:08:45.701625 run iperf3-srv_10.42.42.10(pid=26639): Terminating (SIGTERM) 08:08:45.743446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26640): Terminating (SIGTERM) 08:08:45.786021 run iperf3-srv_10.42.42.10(pid=26641): Terminating (SIGTERM) 08:08:45.827961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26642): Terminating (SIGTERM) 08:08:45.882674 run iperf3-srv_10.42.42.10(pid=26643): Terminating (SIGTERM) 08:08:45.943146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26646): Terminating (SIGTERM) 08:08:45.984602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26649): Terminating (SIGTERM) 08:08:46.029291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26652): Terminating (SIGTERM) 08:08:46.073096 --- ParallelTerminationStrategy: PID 26636 died... 08:08:46.092610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26636): Terminated: ok {rc=0} 08:08:46.139868 --- ParallelTerminationStrategy: PID 26637 died... 08:08:46.159261 run iperf3-srv_10.42.42.10(pid=26637): Terminated {rc=256} 08:08:46.204552 --- ParallelTerminationStrategy: PID 26638 died... 08:08:46.226490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26638): Terminated: ok {rc=0} 08:08:46.271727 --- ParallelTerminationStrategy: PID 26639 died... 08:08:46.291085 run iperf3-srv_10.42.42.10(pid=26639): Terminated {rc=256} 08:08:46.335951 --- ParallelTerminationStrategy: PID 26640 died... 08:08:46.356008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26640): Terminated: ok {rc=0} 08:08:46.403143 --- ParallelTerminationStrategy: PID 26641 died... 08:08:46.424482 run iperf3-srv_10.42.42.10(pid=26641): Terminated {rc=256} 08:08:46.470027 --- ParallelTerminationStrategy: PID 26642 died... 08:08:46.489319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26642): Terminated: ok {rc=0} 08:08:46.534983 --- ParallelTerminationStrategy: PID 26643 died... 08:08:46.554994 run iperf3-srv_10.42.42.10(pid=26643): Terminated {rc=256} 08:08:46.600385 --- ParallelTerminationStrategy: PID 26646 died... 08:08:46.620854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26646): Terminated: ok {rc=0} 08:08:46.666774 --- ParallelTerminationStrategy: PID 26649 died... 08:08:46.686659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26649): Terminated: ok {rc=0} 08:08:46.731500 --- ParallelTerminationStrategy: PID 26652 died... 08:08:46.751109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26652): Terminated: ok {rc=0} 08:08:46.839562 bus /gobi_4: Setting Powered False 08:08:47.936907 bus /gobi_4: Setting Powered False 08:08:49.053580 bus /gobi_1: Setting Powered False 08:08:50.151132 bus /gobi_1: Setting Powered False 08:08:51.268888 bus /gobi_0: Setting Powered False 08:08:52.367077 bus /gobi_0: Setting Powered False 08:08:53.479745 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 08:08:54.584172 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:54.596720 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:08:54.648062 tst ping.py: using LAC 39563 08:08:54.777644 tst ping.py: using RAC 38 08:08:54.895372 tst ping.py: using CellId 39563 08:08:55.014862 tst ping.py: using BVCI 39564 08:08:55.124788 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:55.135925 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:55.146838 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:55.157666 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:55.168401 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:55.179158 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:55.190093 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:08:55.200849 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:08:55.319743 tst ping.py:19: start network... 08:08:55.536030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:56.032680 run create_hlr_db(pid=26654): Launched 08:08:56.155895 bus /gobi_6: Setting Powered False 08:08:57.220271 run create_hlr_db(pid=26654): Terminated: ok {rc=0} 08:08:57.649936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26656): Launched 08:08:57.948888 run osmo-hlr_10.42.42.2(pid=26657): Launched 08:08:58.061626 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:58.596688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26659): Launched 08:08:58.896063 run osmo-stp_10.42.42.5(pid=26660): Launched 08:08:59.009869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:08:59.524842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26662): Launched 08:08:59.640040 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:08:59.893733 run patchelf(pid=26663): Launched 08:09:00.061081 run osmo-stp_10.42.42.5(pid=26660): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26660)] 08:09:00.187794 run osmo-stp_10.42.42.5(pid=26660): stdout: | (launched: 2022-12-14_08:08:58.840791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:00.316249 run osmo-stp_10.42.42.5(pid=26660): stderr: | 20221214080859006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080859006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080859006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080859007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080859007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080859007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080859008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:00.444712 run osmo-stp_10.42.42.5(pid=26660): stdout: | (launched: 2022-12-14_08:08:58.840791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:00.567484 run osmo-stp_10.42.42.5(pid=26660): stderr: | 20221214080859006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080859006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080859006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080859007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080859007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080859007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080859008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:00.711903 run patchelf(pid=26663): Terminating (SIGINT) 08:09:00.886519 run patchelf(pid=26663): Terminated: ok {rc=0} 08:09:01.018056 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26660): Process ended prematurely: osmo-stp_10.42.42.5(pid=26660) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26660)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 08:09:01.027747 tst ping.py:22: Test FAILED (6.4 sec) 08:09:01.056210 run osmo-hlr_10.42.42.2(pid=26657): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26657)] 08:09:01.105122 run osmo-hlr_10.42.42.2(pid=26657): stdout: | (launched: 2022-12-14_08:08:57.893381) 08:09:01.155498 run osmo-hlr_10.42.42.2(pid=26657): stderr: | 20221214080858066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080858066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080858066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080858066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080858066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080858066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080858079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080858090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080858090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080858090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:01.206186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26656): Terminating (SIGTERM) 08:09:01.247139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26659): Terminating (SIGTERM) 08:09:01.288850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26662): Terminating (SIGTERM) 08:09:01.330725 --- ParallelTerminationStrategy: PID 26656 died... 08:09:01.350732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26656): Terminated: ok {rc=0} 08:09:01.397557 --- ParallelTerminationStrategy: PID 26659 died... 08:09:01.416468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26659): Terminated: ok {rc=0} 08:09:01.461875 --- ParallelTerminationStrategy: PID 26662 died... 08:09:01.480710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26662): Terminated: ok {rc=0} 08:09:01.576164 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:09:02.684092 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:09:02.703040 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:09:02.772346 tst ping_idle_ping.py: using LAC 39564 08:09:02.941523 tst ping_idle_ping.py: using RAC 39 08:09:03.095007 tst ping_idle_ping.py: using CellId 39564 08:09:03.261834 tst ping_idle_ping.py: using BVCI 39565 08:09:03.413769 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:09:03.430683 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:09:03.447573 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:09:03.462568 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:09:03.476462 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:09:03.495142 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:09:03.513425 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:09:03.526974 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:09:03.680474 tst ping_idle_ping.py:24: start network... 08:09:03.935759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:04.456017 run create_hlr_db(pid=26934): Launched 08:09:04.607331 bus /gobi_6: Setting Powered False 08:09:05.673243 run create_hlr_db(pid=26934): Terminated: ok {rc=0} 08:09:06.142103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26937): Launched 08:09:06.486287 run osmo-hlr_10.42.42.2(pid=26939): Launched 08:09:06.738514 run osmo-stp_10.42.42.5: Starting osmo-stp 08:09:07.399738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26941): Launched 08:09:07.746812 run osmo-stp_10.42.42.5(pid=26942): Launched 08:09:07.995135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:09:08.648149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26944): Launched 08:09:08.787646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:09:09.072053 run patchelf(pid=26945): Launched 08:09:09.271515 run osmo-stp_10.42.42.5(pid=26942): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26942)] 08:09:09.414168 run osmo-stp_10.42.42.5(pid=26942): stdout: | (launched: 2022-12-14_08:09:07.684439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:09.560043 run osmo-stp_10.42.42.5(pid=26942): stderr: | 20221214080907976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080907976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080907976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080907985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080907986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080907986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080907986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:09.706094 run osmo-stp_10.42.42.5(pid=26942): stdout: | (launched: 2022-12-14_08:09:07.684439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:09.846808 run osmo-stp_10.42.42.5(pid=26942): stderr: | 20221214080907976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080907976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080907976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080907985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080907986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080907986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080907986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:10.008709 run patchelf(pid=26945): Terminating (SIGINT) 08:09:10.199216 run patchelf(pid=26945): Terminated: ok {rc=0} 08:09:10.337704 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26942): Process ended prematurely: osmo-stp_10.42.42.5(pid=26942) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26942)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 08:09:10.348735 tst ping_idle_ping.py:27: Test FAILED (7.7 sec) 08:09:10.378718 run osmo-hlr_10.42.42.2(pid=26939): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26939)] 08:09:10.435332 run osmo-hlr_10.42.42.2(pid=26939): stdout: | (launched: 2022-12-14_08:09:06.424607) 08:09:10.489809 run osmo-hlr_10.42.42.2(pid=26939): stderr: | 20221214080906726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080906726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080906726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080906726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080906726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080906726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080906745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080906758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080906758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080906758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:10.545295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26937): Terminating (SIGTERM) 08:09:10.590071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26941): Terminating (SIGTERM) 08:09:10.637570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26944): Terminating (SIGTERM) 08:09:10.684707 --- ParallelTerminationStrategy: PID 26937 died... 08:09:10.707329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26937): Terminated: ok {rc=0} 08:09:10.757408 --- ParallelTerminationStrategy: PID 26941 died... 08:09:10.779091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26941): Terminated: ok {rc=0} 08:09:10.830167 --- ParallelTerminationStrategy: PID 26944 died... 08:09:10.851960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26944): Terminated: ok {rc=0} 08:09:10.945514 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:09:12.259316 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:09:12.267829 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:09:12.304552 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:09:12.347946 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:09:12.448080 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:09:12.483850 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:09:12.527416 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:09:13.118247 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:09:13.178393 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:13.191180 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:09:13.266478 tst cs_paging_gprs_active.py: using LAC 39565 08:09:13.400375 tst cs_paging_gprs_active.py: using RAC 40 08:09:13.533444 tst cs_paging_gprs_active.py: using CellId 39565 08:09:13.668234 tst cs_paging_gprs_active.py: using BVCI 39566 08:09:13.795302 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:13.807936 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:13.821987 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:13.834535 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:13.848184 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:13.861377 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:13.874757 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:13.888273 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:13.901827 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:09:14.031023 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:09:14.158182 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:09:14.389655 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:09:14.733545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26949): Launched 08:09:15.043274 run iperf3-srv_10.42.42.10(pid=26950): Launched 08:09:15.176865 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:09:15.390062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:09:15.708283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26951): Launched 08:09:16.036706 run iperf3-srv_10.42.42.10(pid=26952): Launched 08:09:16.170658 tst cs_paging_gprs_active.py:38: start network... 08:09:16.382440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:16.871891 run create_hlr_db(pid=26953): Launched 08:09:17.068566 bus /gobi_6: Setting Powered False 08:09:18.135373 run create_hlr_db(pid=26953): Terminated: ok {rc=0} 08:09:18.614771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26955): Launched 08:09:18.971275 run osmo-hlr_10.42.42.2(pid=26956): Launched 08:09:19.225745 run osmo-stp_10.42.42.5: Starting osmo-stp 08:09:19.908833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26958): Launched 08:09:20.264118 run osmo-stp_10.42.42.5(pid=26959): Launched 08:09:20.525644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:09:21.205201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26961): Launched 08:09:21.349118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:09:21.642184 run patchelf(pid=26962): Launched 08:09:21.848562 run osmo-stp_10.42.42.5(pid=26959): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26959)] 08:09:21.995332 run osmo-stp_10.42.42.5(pid=26959): stdout: | (launched: 2022-12-14_08:09:20.201079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:22.143905 run osmo-stp_10.42.42.5(pid=26959): stderr: | 20221214080920494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080920494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080920495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080920495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080920496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080920496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080920496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:22.291503 run osmo-stp_10.42.42.5(pid=26959): stdout: | (launched: 2022-12-14_08:09:20.201079) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:22.433976 run osmo-stp_10.42.42.5(pid=26959): stderr: | 20221214080920494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080920494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080920495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080920495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080920496 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080920496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080920496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:22.603128 run patchelf(pid=26962): Terminating (SIGINT) 08:09:22.800182 run patchelf(pid=26962): Terminated: ok {rc=0} 08:09:22.944790 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26959): Process ended prematurely: osmo-stp_10.42.42.5(pid=26959) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26959)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:09:22.956436 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 08:09:22.987219 run osmo-hlr_10.42.42.2(pid=26956): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26956)] 08:09:23.044411 run osmo-hlr_10.42.42.2(pid=26956): stdout: | (launched: 2022-12-14_08:09:18.909203) 08:09:23.099635 run osmo-hlr_10.42.42.2(pid=26956): stderr: | 20221214080919207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080919207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080919207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080919207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080919207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080919207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080919227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080919239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080919239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080919239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:23.155718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26949): Terminating (SIGTERM) 08:09:23.200282 run iperf3-srv_10.42.42.10(pid=26950): Terminating (SIGTERM) 08:09:23.249532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26951): Terminating (SIGTERM) 08:09:23.295407 run iperf3-srv_10.42.42.10(pid=26952): Terminating (SIGTERM) 08:09:23.344600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26955): Terminating (SIGTERM) 08:09:23.390377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26958): Terminating (SIGTERM) 08:09:23.438663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26961): Terminating (SIGTERM) 08:09:23.486546 --- ParallelTerminationStrategy: PID 26949 died... 08:09:23.509288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26949): Terminated: ok {rc=0} 08:09:23.561278 --- ParallelTerminationStrategy: PID 26950 died... 08:09:23.583286 run iperf3-srv_10.42.42.10(pid=26950): Terminated {rc=256} 08:09:23.635198 --- ParallelTerminationStrategy: PID 26951 died... 08:09:23.655898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26951): Terminated: ok {rc=0} 08:09:23.705448 --- ParallelTerminationStrategy: PID 26952 died... 08:09:23.727056 run iperf3-srv_10.42.42.10(pid=26952): Terminated {rc=256} 08:09:23.776213 --- ParallelTerminationStrategy: PID 26955 died... 08:09:23.799134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26955): Terminated: ok {rc=0} 08:09:23.851584 --- ParallelTerminationStrategy: PID 26958 died... 08:09:23.872489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26958): Terminated: ok {rc=0} 08:09:23.922397 --- ParallelTerminationStrategy: PID 26961 died... 08:09:23.944304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26961): Terminated: ok {rc=0} 08:09:24.040110 bus /gobi_0: Setting Powered False 08:09:25.146196 bus /gobi_0: Setting Powered False 08:09:26.264178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:09:27.414683 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:27.427031 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:09:27.497372 tst iperf3.py: using LAC 39566 08:09:27.627102 tst iperf3.py: using RAC 41 08:09:27.748417 tst iperf3.py: using CellId 39566 08:09:27.869065 tst iperf3.py: using BVCI 39567 08:09:27.981552 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:27.992489 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:28.003267 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:28.014074 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:28.024860 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:28.035729 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:28.046641 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:28.057352 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:28.068557 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:09:28.190555 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:09:28.399143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:09:28.710547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26964): Launched 08:09:28.984496 run iperf3-srv_10.42.42.10(pid=26965): Launched 08:09:29.100868 tst iperf3.py:8: start network... 08:09:29.307496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:29.787183 run create_hlr_db(pid=26966): Launched 08:09:29.913475 bus /gobi_6: Setting Powered False 08:09:30.974200 run create_hlr_db(pid=26966): Terminated: ok {rc=0} 08:09:31.494222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26968): Launched 08:09:31.851037 run osmo-hlr_10.42.42.2(pid=26969): Launched 08:09:32.002180 run osmo-stp_10.42.42.5: Starting osmo-stp 08:09:32.679495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26971): Launched 08:09:33.013275 run osmo-stp_10.42.42.5(pid=26972): Launched 08:09:33.140377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:09:33.710880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26974): Launched 08:09:33.839484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:09:34.119152 run patchelf(pid=26975): Launched 08:09:34.305229 run osmo-stp_10.42.42.5(pid=26972): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26972)] 08:09:34.444652 run osmo-stp_10.42.42.5(pid=26972): stdout: | (launched: 2022-12-14_08:09:32.952256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:34.586405 run osmo-stp_10.42.42.5(pid=26972): stderr: | 20221214080933145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080933145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080933145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080933146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080933146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080933146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080933146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:34.728131 run osmo-stp_10.42.42.5(pid=26972): stdout: | (launched: 2022-12-14_08:09:32.952256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:34.863557 run osmo-stp_10.42.42.5(pid=26972): stderr: | 20221214080933145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080933145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080933145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080933146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080933146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080933146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080933146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:35.023810 run patchelf(pid=26975): Terminating (SIGINT) 08:09:35.210338 run patchelf(pid=26975): Terminated: ok {rc=0} 08:09:35.345090 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26972): Process ended prematurely: osmo-stp_10.42.42.5(pid=26972) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26972)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 08:09:35.355352 tst iperf3.py:8: Test FAILED (8.0 sec) 08:09:35.383911 run osmo-hlr_10.42.42.2(pid=26969): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26969)] 08:09:35.434259 run osmo-hlr_10.42.42.2(pid=26969): stdout: | (launched: 2022-12-14_08:09:31.786286) 08:09:35.486162 run osmo-hlr_10.42.42.2(pid=26969): stderr: | 20221214080932137 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080932137 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080932137 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080932137 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080932137 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080932137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080932161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080932183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080932184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080932184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:35.538510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26964): Terminating (SIGTERM) 08:09:35.580864 run iperf3-srv_10.42.42.10(pid=26965): Terminating (SIGTERM) 08:09:35.622789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26968): Terminating (SIGTERM) 08:09:35.665074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26971): Terminating (SIGTERM) 08:09:35.706827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26974): Terminating (SIGTERM) 08:09:35.749464 --- ParallelTerminationStrategy: PID 26964 died... 08:09:35.769747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26964): Terminated: ok {rc=0} 08:09:35.815999 --- ParallelTerminationStrategy: PID 26965 died... 08:09:35.835707 run iperf3-srv_10.42.42.10(pid=26965): Terminated {rc=256} 08:09:35.881686 --- ParallelTerminationStrategy: PID 26968 died... 08:09:35.901309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26968): Terminated: ok {rc=0} 08:09:35.947744 --- ParallelTerminationStrategy: PID 26971 died... 08:09:35.967719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26971): Terminated: ok {rc=0} 08:09:36.013933 --- ParallelTerminationStrategy: PID 26974 died... 08:09:36.033821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26974): Terminated: ok {rc=0} 08:09:36.122548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:09:37.274761 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:37.287180 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:09:37.356801 tst iperf3m4.py: using LAC 39567 08:09:37.486436 tst iperf3m4.py: using RAC 42 08:09:37.615556 tst iperf3m4.py: using CellId 39567 08:09:37.747026 tst iperf3m4.py: using BVCI 39568 08:09:37.869068 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:37.880655 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:37.892145 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:37.903544 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:37.915229 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:37.926889 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:37.938747 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:37.950373 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:37.962244 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:09:38.081714 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:09:38.205518 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:09:38.329856 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:09:38.450215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:09:38.658370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:09:38.970592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26976): Launched 08:09:39.242747 run iperf3-srv_10.42.42.10(pid=26977): Launched 08:09:39.361419 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:09:39.569084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:09:39.880343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26978): Launched 08:09:40.151521 run iperf3-srv_10.42.42.10(pid=26979): Launched 08:09:40.267615 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:09:40.474543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:09:40.784693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26980): Launched 08:09:41.056294 run iperf3-srv_10.42.42.10(pid=26981): Launched 08:09:41.172904 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:09:41.380104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:09:41.691901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26982): Launched 08:09:41.962783 run iperf3-srv_10.42.42.10(pid=26983): Launched 08:09:42.080720 tst iperf3m4.py:8: start network... 08:09:42.287444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:42.765298 run create_hlr_db(pid=26984): Launched 08:09:42.894576 bus /gobi_6: Setting Powered False 08:09:43.955349 run create_hlr_db(pid=26984): Terminated: ok {rc=0} 08:09:44.405649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26986): Launched 08:09:44.742292 run osmo-hlr_10.42.42.2(pid=26987): Launched 08:09:44.870064 run osmo-stp_10.42.42.5: Starting osmo-stp 08:09:45.445220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26989): Launched 08:09:45.779590 run osmo-stp_10.42.42.5(pid=26990): Launched 08:09:45.987014 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:09:46.570285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26992): Launched 08:09:46.728173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:09:47.014084 run patchelf(pid=26993): Launched 08:09:47.230792 run osmo-stp_10.42.42.5(pid=26990): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26990)] 08:09:47.363175 run osmo-stp_10.42.42.5(pid=26990): stdout: | (launched: 2022-12-14_08:09:45.718839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:47.495583 run osmo-stp_10.42.42.5(pid=26990): stderr: | 20221214080945929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080945929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080945929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080945930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080945930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080945930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080945930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:47.627809 run osmo-stp_10.42.42.5(pid=26990): stdout: | (launched: 2022-12-14_08:09:45.718839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:09:47.753566 run osmo-stp_10.42.42.5(pid=26990): stderr: | 20221214080945929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214080945929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214080945929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214080945930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214080945930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214080945930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214080945930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:09:47.902814 run patchelf(pid=26993): Terminating (SIGINT) 08:09:48.077938 run patchelf(pid=26993): Terminated: ok {rc=0} 08:09:48.204085 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26990): Process ended prematurely: osmo-stp_10.42.42.5(pid=26990) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26990)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:09:48.213828 tst iperf3m4.py:8: Test FAILED (11.0 sec) 08:09:48.241563 run osmo-hlr_10.42.42.2(pid=26987): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26987)] 08:09:48.289533 run osmo-hlr_10.42.42.2(pid=26987): stdout: | (launched: 2022-12-14_08:09:44.681010) 08:09:48.339383 run osmo-hlr_10.42.42.2(pid=26987): stderr: | 20221214080944881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214080944881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214080944881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214080944881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214080944881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214080944881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214080944892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214080944902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214080944902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214080944902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:09:48.389493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26976): Terminating (SIGTERM) 08:09:48.429814 run iperf3-srv_10.42.42.10(pid=26977): Terminating (SIGTERM) 08:09:48.470147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26978): Terminating (SIGTERM) 08:09:48.510373 run iperf3-srv_10.42.42.10(pid=26979): Terminating (SIGTERM) 08:09:48.550387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26980): Terminating (SIGTERM) 08:09:48.590528 run iperf3-srv_10.42.42.10(pid=26981): Terminating (SIGTERM) 08:09:48.630548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26982): Terminating (SIGTERM) 08:09:48.670579 run iperf3-srv_10.42.42.10(pid=26983): Terminating (SIGTERM) 08:09:48.710463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26986): Terminating (SIGTERM) 08:09:48.750415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26989): Terminating (SIGTERM) 08:09:48.790364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26992): Terminating (SIGTERM) 08:09:48.830858 --- ParallelTerminationStrategy: PID 26976 died... 08:09:48.850300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26976): Terminated: ok {rc=0} 08:09:48.894798 --- ParallelTerminationStrategy: PID 26977 died... 08:09:48.914220 run iperf3-srv_10.42.42.10(pid=26977): Terminated {rc=256} 08:09:48.958225 --- ParallelTerminationStrategy: PID 26978 died... 08:09:48.977051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26978): Terminated: ok {rc=0} 08:09:49.021093 --- ParallelTerminationStrategy: PID 26979 died... 08:09:49.039789 run iperf3-srv_10.42.42.10(pid=26979): Terminated {rc=256} 08:09:49.083425 --- ParallelTerminationStrategy: PID 26980 died... 08:09:49.102217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26980): Terminated: ok {rc=0} 08:09:49.146213 --- ParallelTerminationStrategy: PID 26981 died... 08:09:49.165152 run iperf3-srv_10.42.42.10(pid=26981): Terminated {rc=256} 08:09:49.209070 --- ParallelTerminationStrategy: PID 26982 died... 08:09:49.227956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26982): Terminated: ok {rc=0} 08:09:49.272002 --- ParallelTerminationStrategy: PID 26983 died... 08:09:49.290783 run iperf3-srv_10.42.42.10(pid=26983): Terminated {rc=256} 08:09:49.334701 --- ParallelTerminationStrategy: PID 26986 died... 08:09:49.353643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26986): Terminated: ok {rc=0} 08:09:49.397553 --- ParallelTerminationStrategy: PID 26989 died... 08:09:49.416476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26989): Terminated: ok {rc=0} 08:09:49.460633 --- ParallelTerminationStrategy: PID 26992 died... 08:09:49.479656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26992): Terminated: ok {rc=0} 08:09:49.565786 bus /gobi_4: Setting Powered False 08:09:50.665392 bus /gobi_4: Setting Powered False 08:09:51.776788 bus /gobi_1: Setting Powered False 08:09:52.875446 bus /gobi_1: Setting Powered False 08:09:53.993173 bus /gobi_0: Setting Powered False 08:09:55.092064 bus /gobi_0: Setting Powered False 08:09:56.210002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:09:57.312423 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:57.324822 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:09:57.395661 tst ping.py: using LAC 39568 08:09:57.517954 tst ping.py: using RAC 43 08:09:57.637096 tst ping.py: using CellId 39568 08:09:57.757312 tst ping.py: using BVCI 39569 08:09:57.867791 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:57.879068 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:57.890039 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:57.901034 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:57.911805 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:57.922769 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:57.933676 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:09:57.944424 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:09:58.062473 tst ping.py:19: start network... 08:09:58.265959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:09:58.735753 run create_hlr_db(pid=26995): Launched 08:09:58.860220 bus /gobi_6: Setting Powered False 08:09:59.921354 run create_hlr_db(pid=26995): Terminated: ok {rc=0} 08:10:00.366581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26997): Launched 08:10:00.695324 run osmo-hlr_10.42.42.2(pid=26998): Launched 08:10:00.820942 run osmo-stp_10.42.42.5: Starting osmo-stp 08:10:01.498740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27000): Launched 08:10:01.910115 run osmo-stp_10.42.42.5(pid=27004): Launched 08:10:02.092750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:10:02.820505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27006): Launched 08:10:02.946494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:10:03.222199 run patchelf(pid=27007): Launched 08:10:03.407285 run osmo-stp_10.42.42.5(pid=27004): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27004)] 08:10:03.546630 run osmo-stp_10.42.42.5(pid=27004): stdout: | (launched: 2022-12-14_08:10:01.821709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:03.688020 run osmo-stp_10.42.42.5(pid=27004): stderr: | 20221214081002180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081002180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081002180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081002181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081002182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081002182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081002182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:03.828243 run osmo-stp_10.42.42.5(pid=27004): stdout: | (launched: 2022-12-14_08:10:01.821709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:03.961949 run osmo-stp_10.42.42.5(pid=27004): stderr: | 20221214081002180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081002180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081002180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081002181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081002182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081002182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081002182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:04.120401 run patchelf(pid=27007): Terminating (SIGINT) 08:10:04.305324 run patchelf(pid=27007): Terminated: ok {rc=0} 08:10:04.438795 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27004): Process ended prematurely: osmo-stp_10.42.42.5(pid=27004) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27004)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 08:10:04.448455 tst ping.py:22: Test FAILED (7.1 sec) 08:10:04.477113 run osmo-hlr_10.42.42.2(pid=26998): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26998)] 08:10:04.527999 run osmo-hlr_10.42.42.2(pid=26998): stdout: | (launched: 2022-12-14_08:10:00.635628) 08:10:04.581281 run osmo-hlr_10.42.42.2(pid=26998): stderr: | 20221214081000833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081000833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081000833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081000833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081000833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081000833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081000851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081000862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081000862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081000862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:10:04.633986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26997): Terminating (SIGTERM) 08:10:04.675937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27000): Terminating (SIGTERM) 08:10:04.718699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27006): Terminating (SIGTERM) 08:10:04.761379 --- ParallelTerminationStrategy: PID 26997 died... 08:10:04.782121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26997): Terminated: ok {rc=0} 08:10:04.829180 --- ParallelTerminationStrategy: PID 27000 died... 08:10:04.849198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27000): Terminated: ok {rc=0} 08:10:04.895859 --- ParallelTerminationStrategy: PID 27006 died... 08:10:04.915945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27006): Terminated: ok {rc=0} 08:10:05.004174 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:10:06.093687 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:10:06.106222 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:10:06.174531 tst ping_idle_ping.py: using LAC 39569 08:10:06.293652 tst ping_idle_ping.py: using RAC 44 08:10:06.415870 tst ping_idle_ping.py: using CellId 39569 08:10:06.534868 tst ping_idle_ping.py: using BVCI 39570 08:10:06.646210 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:10:06.657460 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:10:06.668471 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:10:06.679403 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:10:06.690369 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:10:06.701350 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:10:06.712296 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:10:06.723260 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:10:06.839901 tst ping_idle_ping.py:24: start network... 08:10:07.061961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:10:07.571348 run create_hlr_db(pid=27008): Launched 08:10:07.699235 bus /gobi_6: Setting Powered False 08:10:08.763489 run create_hlr_db(pid=27008): Terminated: ok {rc=0} 08:10:09.200213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27010): Launched 08:10:09.505283 run osmo-hlr_10.42.42.2(pid=27011): Launched 08:10:09.622618 run osmo-stp_10.42.42.5: Starting osmo-stp 08:10:10.160333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27013): Launched 08:10:10.465482 run osmo-stp_10.42.42.5(pid=27014): Launched 08:10:10.583133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:10:11.114079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27016): Launched 08:10:11.234362 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:10:11.494039 run patchelf(pid=27017): Launched 08:10:11.666467 run osmo-stp_10.42.42.5(pid=27014): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27014)] 08:10:11.795371 run osmo-stp_10.42.42.5(pid=27014): stdout: | (launched: 2022-12-14_08:10:10.408847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:11.925728 run osmo-stp_10.42.42.5(pid=27014): stderr: | 20221214081010578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081010578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081010578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081010579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081010579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081010579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081010579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:12.056003 run osmo-stp_10.42.42.5(pid=27014): stdout: | (launched: 2022-12-14_08:10:10.408847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:12.179764 run osmo-stp_10.42.42.5(pid=27014): stderr: | 20221214081010578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081010578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081010578 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081010579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081010579 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081010579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081010579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:12.326560 run patchelf(pid=27017): Terminating (SIGINT) 08:10:12.498182 run patchelf(pid=27017): Terminated: ok {rc=0} 08:10:12.621929 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27014): Process ended prematurely: osmo-stp_10.42.42.5(pid=27014) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27014)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:10:12.630814 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:10:12.658206 run osmo-hlr_10.42.42.2(pid=27011): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27011)] 08:10:12.705527 run osmo-hlr_10.42.42.2(pid=27011): stdout: | (launched: 2022-12-14_08:10:09.448907) 08:10:12.754758 run osmo-hlr_10.42.42.2(pid=27011): stderr: | 20221214081009625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081009625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081009625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081009626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081009626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081009626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081009638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081009647 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081009647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081009647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:10:12.804166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27010): Terminating (SIGTERM) 08:10:12.844115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27013): Terminating (SIGTERM) 08:10:12.883931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27016): Terminating (SIGTERM) 08:10:12.923779 --- ParallelTerminationStrategy: PID 27010 died... 08:10:12.943066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27010): Terminated: ok {rc=0} 08:10:12.986990 --- ParallelTerminationStrategy: PID 27013 died... 08:10:13.005698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27013): Terminated: ok {rc=0} 08:10:13.049383 --- ParallelTerminationStrategy: PID 27016 died... 08:10:13.068096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27016): Terminated: ok {rc=0} 08:10:13.152320 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:10:14.471700 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:10:14.480376 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:10:14.514664 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 08:10:14.554746 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 08:10:14.643094 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:10:14.675887 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 08:10:14.715119 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 08:10:15.319851 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 08:10:15.372941 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:15.384825 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:10:15.434767 tst cs_paging_gprs_active.py: using LAC 39570 08:10:15.552851 tst cs_paging_gprs_active.py: using RAC 45 08:10:15.671667 tst cs_paging_gprs_active.py: using CellId 39570 08:10:15.790969 tst cs_paging_gprs_active.py: using BVCI 39571 08:10:15.907942 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:15.920058 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:15.932018 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:15.943776 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:15.955439 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:15.966983 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:15.978857 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:15.990913 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:16.003229 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:10:16.127202 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:10:16.274333 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:10:16.543994 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:10:16.863144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27021): Launched 08:10:17.147372 run iperf3-srv_10.42.42.10(pid=27022): Launched 08:10:17.298748 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:10:17.521001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:10:17.851730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27023): Launched 08:10:18.137345 run iperf3-srv_10.42.42.10(pid=27024): Launched 08:10:18.260657 tst cs_paging_gprs_active.py:38: start network... 08:10:18.481313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:10:18.991139 run create_hlr_db(pid=27025): Launched 08:10:19.118504 bus /gobi_6: Setting Powered False 08:10:20.182942 run create_hlr_db(pid=27025): Terminated: ok {rc=0} 08:10:20.622311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27027): Launched 08:10:20.932781 run osmo-hlr_10.42.42.2(pid=27028): Launched 08:10:21.050158 run osmo-stp_10.42.42.5: Starting osmo-stp 08:10:21.576549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27030): Launched 08:10:21.883137 run osmo-stp_10.42.42.5(pid=27031): Launched 08:10:21.999447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:10:22.528654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27033): Launched 08:10:22.646097 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:10:22.905298 run patchelf(pid=27034): Launched 08:10:23.076133 run osmo-stp_10.42.42.5(pid=27031): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27031)] 08:10:23.206503 run osmo-stp_10.42.42.5(pid=27031): stdout: | (launched: 2022-12-14_08:10:21.826151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:23.336879 run osmo-stp_10.42.42.5(pid=27031): stderr: | 20221214081021995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081021995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081021996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081021996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081021996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081021997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081021997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:23.466971 run osmo-stp_10.42.42.5(pid=27031): stdout: | (launched: 2022-12-14_08:10:21.826151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:23.591939 run osmo-stp_10.42.42.5(pid=27031): stderr: | 20221214081021995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081021995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081021996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081021996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081021996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081021997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081021997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:23.740057 run patchelf(pid=27034): Terminating (SIGINT) 08:10:23.913217 run patchelf(pid=27034): Terminated: ok {rc=0} 08:10:24.038421 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27031): Process ended prematurely: osmo-stp_10.42.42.5(pid=27031) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27031)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 08:10:24.048141 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:10:24.075292 run osmo-hlr_10.42.42.2(pid=27028): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27028)] 08:10:24.122763 run osmo-hlr_10.42.42.2(pid=27028): stdout: | (launched: 2022-12-14_08:10:20.876340) 08:10:24.171925 run osmo-hlr_10.42.42.2(pid=27028): stderr: | 20221214081021051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081021051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081021051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081021051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081021051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081021051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081021063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081021073 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081021073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081021073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:10:24.221541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27021): Terminating (SIGTERM) 08:10:24.261507 run iperf3-srv_10.42.42.10(pid=27022): Terminating (SIGTERM) 08:10:24.301464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27023): Terminating (SIGTERM) 08:10:24.341350 run iperf3-srv_10.42.42.10(pid=27024): Terminating (SIGTERM) 08:10:24.380931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27027): Terminating (SIGTERM) 08:10:24.420754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27030): Terminating (SIGTERM) 08:10:24.460658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27033): Terminating (SIGTERM) 08:10:24.500438 --- ParallelTerminationStrategy: PID 27021 died... 08:10:24.519504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27021): Terminated: ok {rc=0} 08:10:24.563585 --- ParallelTerminationStrategy: PID 27022 died... 08:10:24.582095 run iperf3-srv_10.42.42.10(pid=27022): Terminated {rc=256} 08:10:24.625416 --- ParallelTerminationStrategy: PID 27023 died... 08:10:24.643818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27023): Terminated: ok {rc=0} 08:10:24.687327 --- ParallelTerminationStrategy: PID 27024 died... 08:10:24.705675 run iperf3-srv_10.42.42.10(pid=27024): Terminated {rc=256} 08:10:24.749151 --- ParallelTerminationStrategy: PID 27027 died... 08:10:24.767524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27027): Terminated: ok {rc=0} 08:10:24.811285 --- ParallelTerminationStrategy: PID 27030 died... 08:10:24.829759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27030): Terminated: ok {rc=0} 08:10:24.873124 --- ParallelTerminationStrategy: PID 27033 died... 08:10:24.891566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27033): Terminated: ok {rc=0} 08:10:24.977669 bus /gobi_0: Setting Powered False 08:10:26.077635 bus /gobi_0: Setting Powered False 08:10:27.193104 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 08:10:28.344446 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:28.357431 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:10:28.409787 tst iperf3.py: using LAC 39571 08:10:28.531544 tst iperf3.py: using RAC 46 08:10:28.653402 tst iperf3.py: using CellId 39571 08:10:28.774530 tst iperf3.py: using BVCI 39572 08:10:28.887903 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:28.899523 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:28.910916 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:28.922155 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:28.933369 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:28.944554 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:28.955812 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:28.966919 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:28.978242 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:10:29.100829 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:10:29.321134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:10:29.649622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27035): Launched 08:10:29.936065 run iperf3-srv_10.42.42.10(pid=27036): Launched 08:10:30.058945 tst iperf3.py:8: start network... 08:10:30.278167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:10:30.784457 run create_hlr_db(pid=27037): Launched 08:10:30.935143 bus /gobi_6: Setting Powered False 08:10:31.999626 run create_hlr_db(pid=27037): Terminated: ok {rc=0} 08:10:32.463735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27039): Launched 08:10:32.794026 run osmo-hlr_10.42.42.2(pid=27040): Launched 08:10:32.921479 run osmo-stp_10.42.42.5: Starting osmo-stp 08:10:33.486840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27042): Launched 08:10:33.816888 run osmo-stp_10.42.42.5(pid=27043): Launched 08:10:33.943684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:10:34.507533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27045): Launched 08:10:34.636056 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:10:34.912362 run patchelf(pid=27046): Launched 08:10:35.096512 run osmo-stp_10.42.42.5(pid=27043): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27043)] 08:10:35.235215 run osmo-stp_10.42.42.5(pid=27043): stdout: | (launched: 2022-12-14_08:10:33.757245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:35.375813 run osmo-stp_10.42.42.5(pid=27043): stderr: | 20221214081033951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081033951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081033951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081033951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081033952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081033952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081033952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:35.516276 run osmo-stp_10.42.42.5(pid=27043): stdout: | (launched: 2022-12-14_08:10:33.757245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:35.650854 run osmo-stp_10.42.42.5(pid=27043): stderr: | 20221214081033951 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081033951 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081033951 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081033951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081033952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081033952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081033952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:35.809575 run patchelf(pid=27046): Terminating (SIGINT) 08:10:35.993984 run patchelf(pid=27046): Terminated: ok {rc=0} 08:10:36.127575 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27043): Process ended prematurely: osmo-stp_10.42.42.5(pid=27043) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27043)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 08:10:36.137930 tst iperf3.py:8: Test FAILED (7.8 sec) 08:10:36.166366 run osmo-hlr_10.42.42.2(pid=27040): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27040)] 08:10:36.217249 run osmo-hlr_10.42.42.2(pid=27040): stdout: | (launched: 2022-12-14_08:10:32.734070) 08:10:36.269821 run osmo-hlr_10.42.42.2(pid=27040): stderr: | 20221214081032931 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081032931 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081032931 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081032931 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081032931 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081032931 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081032943 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081032951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081032951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081032951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:10:36.322661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27035): Terminating (SIGTERM) 08:10:36.364471 run iperf3-srv_10.42.42.10(pid=27036): Terminating (SIGTERM) 08:10:36.406630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27039): Terminating (SIGTERM) 08:10:36.448809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27042): Terminating (SIGTERM) 08:10:36.491345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27045): Terminating (SIGTERM) 08:10:36.533650 --- ParallelTerminationStrategy: PID 27035 died... 08:10:36.553894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27035): Terminated: ok {rc=0} 08:10:36.600578 --- ParallelTerminationStrategy: PID 27036 died... 08:10:36.620395 run iperf3-srv_10.42.42.10(pid=27036): Terminated {rc=256} 08:10:36.666581 --- ParallelTerminationStrategy: PID 27039 died... 08:10:36.686463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27039): Terminated: ok {rc=0} 08:10:36.732888 --- ParallelTerminationStrategy: PID 27042 died... 08:10:36.753335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27042): Terminated: ok {rc=0} 08:10:36.799814 --- ParallelTerminationStrategy: PID 27045 died... 08:10:36.819608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27045): Terminated: ok {rc=0} 08:10:36.908599 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 08:10:38.057564 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:38.070358 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:10:38.127643 tst iperf3m4.py: using LAC 39572 08:10:38.255155 tst iperf3m4.py: using RAC 47 08:10:38.381654 tst iperf3m4.py: using CellId 39572 08:10:38.501404 tst iperf3m4.py: using BVCI 39573 08:10:38.612111 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:38.623782 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:38.635429 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:38.646892 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:38.658503 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:38.670082 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:38.681496 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:38.692628 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:38.704076 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:10:38.826488 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:10:38.948919 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:10:39.067659 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:10:39.188433 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:10:39.412214 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:10:39.742794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27047): Launched 08:10:40.031725 run iperf3-srv_10.42.42.10(pid=27048): Launched 08:10:40.157383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:10:40.379198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:10:40.709338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27049): Launched 08:10:40.995140 run iperf3-srv_10.42.42.10(pid=27050): Launched 08:10:41.119746 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:10:41.341196 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:10:41.671285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27051): Launched 08:10:41.959627 run iperf3-srv_10.42.42.10(pid=27052): Launched 08:10:42.083371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:10:42.304208 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:10:42.633932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27053): Launched 08:10:42.920284 run iperf3-srv_10.42.42.10(pid=27054): Launched 08:10:43.045535 tst iperf3m4.py:8: start network... 08:10:43.266675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:10:43.775554 run create_hlr_db(pid=27055): Launched 08:10:43.900760 bus /gobi_6: Setting Powered False 08:10:44.965539 run create_hlr_db(pid=27055): Terminated: ok {rc=0} 08:10:45.423591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27057): Launched 08:10:45.752923 run osmo-hlr_10.42.42.2(pid=27058): Launched 08:10:45.879515 run osmo-stp_10.42.42.5: Starting osmo-stp 08:10:46.577244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27060): Launched 08:10:46.922436 run osmo-stp_10.42.42.5(pid=27061): Launched 08:10:47.167226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:10:47.738461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27063): Launched 08:10:47.856307 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:10:48.116247 run patchelf(pid=27064): Launched 08:10:48.287031 run osmo-stp_10.42.42.5(pid=27061): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27061)] 08:10:48.415949 run osmo-stp_10.42.42.5(pid=27061): stdout: | (launched: 2022-12-14_08:10:46.862430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:48.546944 run osmo-stp_10.42.42.5(pid=27061): stderr: | 20221214081047158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081047158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081047158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081047159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081047159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081047159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081047159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:48.677910 run osmo-stp_10.42.42.5(pid=27061): stdout: | (launched: 2022-12-14_08:10:46.862430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:10:48.809261 run osmo-stp_10.42.42.5(pid=27061): stderr: | 20221214081047158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081047158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081047158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081047159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081047159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081047159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081047159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:10:48.988083 run patchelf(pid=27064): Terminating (SIGINT) 08:10:49.174646 run patchelf(pid=27064): Terminated: ok {rc=0} 08:10:49.310004 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27061): Process ended prematurely: osmo-stp_10.42.42.5(pid=27061) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27061)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 08:10:49.320489 tst iperf3m4.py:8: Test FAILED (11.3 sec) 08:10:49.349861 run osmo-hlr_10.42.42.2(pid=27058): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27058)] 08:10:49.400596 run osmo-hlr_10.42.42.2(pid=27058): stdout: | (launched: 2022-12-14_08:10:45.692289) 08:10:49.453238 run osmo-hlr_10.42.42.2(pid=27058): stderr: | 20221214081045934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081045934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081045935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081045935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081045935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081045935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081045951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081045959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081045960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081045960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:10:49.505808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27047): Terminating (SIGTERM) 08:10:49.547701 run iperf3-srv_10.42.42.10(pid=27048): Terminating (SIGTERM) 08:10:49.590577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27049): Terminating (SIGTERM) 08:10:49.632570 run iperf3-srv_10.42.42.10(pid=27050): Terminating (SIGTERM) 08:10:49.674665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27051): Terminating (SIGTERM) 08:10:49.717761 run iperf3-srv_10.42.42.10(pid=27052): Terminating (SIGTERM) 08:10:49.760016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27053): Terminating (SIGTERM) 08:10:49.801952 run iperf3-srv_10.42.42.10(pid=27054): Terminating (SIGTERM) 08:10:49.844223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27057): Terminating (SIGTERM) 08:10:49.886203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27060): Terminating (SIGTERM) 08:10:49.928512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27063): Terminating (SIGTERM) 08:10:49.970799 --- ParallelTerminationStrategy: PID 27047 died... 08:10:49.990716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27047): Terminated: ok {rc=0} 08:10:50.037160 --- ParallelTerminationStrategy: PID 27048 died... 08:10:50.056886 run iperf3-srv_10.42.42.10(pid=27048): Terminated {rc=256} 08:10:50.103137 --- ParallelTerminationStrategy: PID 27049 died... 08:10:50.123056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27049): Terminated: ok {rc=0} 08:10:50.169285 --- ParallelTerminationStrategy: PID 27050 died... 08:10:50.188938 run iperf3-srv_10.42.42.10(pid=27050): Terminated {rc=256} 08:10:50.235046 --- ParallelTerminationStrategy: PID 27051 died... 08:10:50.254860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27051): Terminated: ok {rc=0} 08:10:50.301208 --- ParallelTerminationStrategy: PID 27052 died... 08:10:50.320916 run iperf3-srv_10.42.42.10(pid=27052): Terminated {rc=256} 08:10:50.367110 --- ParallelTerminationStrategy: PID 27053 died... 08:10:50.386901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27053): Terminated: ok {rc=0} 08:10:50.433185 --- ParallelTerminationStrategy: PID 27054 died... 08:10:50.452850 run iperf3-srv_10.42.42.10(pid=27054): Terminated {rc=256} 08:10:50.499133 --- ParallelTerminationStrategy: PID 27057 died... 08:10:50.518944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27057): Terminated: ok {rc=0} 08:10:50.565314 --- ParallelTerminationStrategy: PID 27060 died... 08:10:50.585139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27060): Terminated: ok {rc=0} 08:10:50.631694 --- ParallelTerminationStrategy: PID 27063 died... 08:10:50.651674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27063): Terminated: ok {rc=0} 08:10:50.740168 bus /gobi_4: Setting Powered False 08:10:51.839444 bus /gobi_4: Setting Powered False 08:10:52.955500 bus /gobi_1: Setting Powered False 08:10:54.054707 bus /gobi_1: Setting Powered False 08:10:55.170075 bus /gobi_0: Setting Powered False 08:10:56.268467 bus /gobi_0: Setting Powered False 08:10:57.385851 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 08:10:58.489133 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:58.501842 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:10:58.554027 tst ping.py: using LAC 39573 08:10:58.682111 tst ping.py: using RAC 48 08:10:58.809095 tst ping.py: using CellId 39573 08:10:58.935119 tst ping.py: using BVCI 39574 08:10:59.051962 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:59.064187 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:59.076036 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:59.087829 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:59.099930 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:59.112119 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:59.124265 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:10:59.136269 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:10:59.254639 tst ping.py:19: start network... 08:10:59.456733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:10:59.924537 run create_hlr_db(pid=27067): Launched 08:11:00.048462 bus /gobi_6: Setting Powered False 08:11:01.115104 run create_hlr_db(pid=27067): Terminated: ok {rc=0} 08:11:01.540268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27069): Launched 08:11:01.859834 run osmo-hlr_10.42.42.2(pid=27070): Launched 08:11:02.095605 run osmo-stp_10.42.42.5: Starting osmo-stp 08:11:02.698376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27072): Launched 08:11:03.000673 run osmo-stp_10.42.42.5(pid=27073): Launched 08:11:03.116216 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:11:03.634247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27075): Launched 08:11:03.751546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:11:04.006400 run patchelf(pid=27076): Launched 08:11:04.175803 run osmo-stp_10.42.42.5(pid=27073): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27073)] 08:11:04.302719 run osmo-stp_10.42.42.5(pid=27073): stdout: | (launched: 2022-12-14_08:11:02.945236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:04.431326 run osmo-stp_10.42.42.5(pid=27073): stderr: | 20221214081103111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081103111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081103111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081103112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081103112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081103112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081103112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:04.559930 run osmo-stp_10.42.42.5(pid=27073): stdout: | (launched: 2022-12-14_08:11:02.945236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:04.682629 run osmo-stp_10.42.42.5(pid=27073): stderr: | 20221214081103111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081103111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081103111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081103112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081103112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081103112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081103112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:04.827708 run patchelf(pid=27076): Terminating (SIGINT) 08:11:04.998123 run patchelf(pid=27076): Terminated: ok {rc=0} 08:11:05.120819 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27073): Process ended prematurely: osmo-stp_10.42.42.5(pid=27073) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27073)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 08:11:05.129769 tst ping.py:22: Test FAILED (6.6 sec) 08:11:05.156196 run osmo-hlr_10.42.42.2(pid=27070): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27070)] 08:11:05.202943 run osmo-hlr_10.42.42.2(pid=27070): stdout: | (launched: 2022-12-14_08:11:01.800897) 08:11:05.251745 run osmo-hlr_10.42.42.2(pid=27070): stderr: | 20221214081102023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081102024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081102024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081102024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081102024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081102024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081102039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081102052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081102055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081102058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:05.300882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27069): Terminating (SIGTERM) 08:11:05.340281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27072): Terminating (SIGTERM) 08:11:05.379604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27075): Terminating (SIGTERM) 08:11:05.419173 --- ParallelTerminationStrategy: PID 27069 died... 08:11:05.438401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27069): Terminated: ok {rc=0} 08:11:05.482231 --- ParallelTerminationStrategy: PID 27072 died... 08:11:05.500641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27072): Terminated: ok {rc=0} 08:11:05.544816 --- ParallelTerminationStrategy: PID 27075 died... 08:11:05.564079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27075): Terminated: ok {rc=0} 08:11:05.649062 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 08:11:06.737818 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:11:06.750624 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:11:06.802593 tst ping_idle_ping.py: using LAC 39574 08:11:06.922620 tst ping_idle_ping.py: using RAC 49 08:11:07.042405 tst ping_idle_ping.py: using CellId 39574 08:11:07.162859 tst ping_idle_ping.py: using BVCI 39575 08:11:07.273233 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:11:07.284867 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:11:07.296209 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:11:07.307564 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:11:07.319148 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:11:07.330647 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:11:07.342233 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:11:07.353770 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:11:07.474666 tst ping_idle_ping.py:24: start network... 08:11:07.694852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:08.199464 run create_hlr_db(pid=27077): Launched 08:11:08.323830 bus /gobi_6: Setting Powered False 08:11:09.387785 run create_hlr_db(pid=27077): Terminated: ok {rc=0} 08:11:09.823483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27079): Launched 08:11:10.128012 run osmo-hlr_10.42.42.2(pid=27080): Launched 08:11:10.244007 run osmo-stp_10.42.42.5: Starting osmo-stp 08:11:10.771482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27082): Launched 08:11:11.074068 run osmo-stp_10.42.42.5(pid=27083): Launched 08:11:11.189034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:11:11.710412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27085): Launched 08:11:11.827687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:11:12.083183 run patchelf(pid=27086): Launched 08:11:12.251611 run osmo-stp_10.42.42.5(pid=27083): ERR: Terminated: ERROR {rc=1} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27083)] 08:11:12.379302 run osmo-stp_10.42.42.5(pid=27083): stdout: | (launched: 2022-12-14_08:11:11.018181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:12.508202 run osmo-stp_10.42.42.5(pid=27083): stderr: | 20221214081111187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081111187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081111187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081111188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081111188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081111188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081111189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:12.637426 run osmo-stp_10.42.42.5(pid=27083): stdout: | (launched: 2022-12-14_08:11:11.018181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:12.760142 run osmo-stp_10.42.42.5(pid=27083): stderr: | 20221214081111187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081111187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081111187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081111188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081111188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081111188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081111189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:12.905451 run patchelf(pid=27086): Terminating (SIGINT) 08:11:13.076154 run patchelf(pid=27086): Terminated: ok {rc=0} 08:11:13.199472 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27083): Process ended prematurely: osmo-stp_10.42.42.5(pid=27083) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27083)] [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 08:11:13.208578 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 08:11:13.235424 run osmo-hlr_10.42.42.2(pid=27080): ERR: Terminated: ERROR {rc=237} [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27080)] 08:11:13.282829 run osmo-hlr_10.42.42.2(pid=27080): stdout: | (launched: 2022-12-14_08:11:10.071952) 08:11:13.331922 run osmo-hlr_10.42.42.2(pid=27080): stderr: | 20221214081110247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081110247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081110247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081110247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081110247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081110247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081110259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081110267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081110268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081110268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:13.381581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27079): Terminating (SIGTERM) 08:11:13.421583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27082): Terminating (SIGTERM) 08:11:13.461656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27085): Terminating (SIGTERM) 08:11:13.501806 --- ParallelTerminationStrategy: PID 27079 died... 08:11:13.520906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27079): Terminated: ok {rc=0} 08:11:13.564719 --- ParallelTerminationStrategy: PID 27082 died... 08:11:13.583608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27082): Terminated: ok {rc=0} 08:11:13.627506 --- ParallelTerminationStrategy: PID 27085 died... 08:11:13.646103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27085): Terminated: ok {rc=0} 08:11:13.729332 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 08:11:15.051573 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:11:15.060561 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:11:15.092398 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:11:15.127457 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:11:15.180552 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:11:15.212315 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:11:15.245928 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:11:15.807546 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2401 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:11:15.812570 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:11:15.824405 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:11:15.907567 tst switch_tch_pdch.py: using LAC 39575 08:11:16.048650 tst switch_tch_pdch.py: using RAC 50 08:11:16.171305 tst switch_tch_pdch.py: using CellId 39575 08:11:16.292533 tst switch_tch_pdch.py: using BVCI 39576 08:11:16.414398 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:11:16.427429 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:11:16.440547 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:11:16.453905 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:11:16.467424 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:11:16.481056 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:11:16.494851 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:11:16.508172 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:11:16.636671 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:11:16.793751 tst switch_tch_pdch.py:51: start network... 08:11:17.001249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:17.469836 run create_hlr_db(pid=27092): Launched 08:11:17.593858 bus /gobi_6: Setting Powered False 08:11:18.653581 run create_hlr_db(pid=27092): Terminated: ok {rc=0} 08:11:19.093913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27094): Launched 08:11:19.417128 run osmo-hlr_10.42.42.2(pid=27095): Launched 08:11:19.541385 run osmo-stp_10.42.42.5: Starting osmo-stp 08:11:20.100140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27097): Launched 08:11:20.422470 run osmo-stp_10.42.42.5(pid=27098): Launched 08:11:20.546814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:11:21.105197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27100): Launched 08:11:21.229532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:11:21.502415 run patchelf(pid=27101): Launched 08:11:21.683037 run osmo-stp_10.42.42.5(pid=27098): ERR: Terminated: ERROR {rc=1} [trial-2401↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27098)] 08:11:21.819595 run osmo-stp_10.42.42.5(pid=27098): stdout: | (launched: 2022-12-14_08:11:20.363698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:21.958574 run osmo-stp_10.42.42.5(pid=27098): stderr: | 20221214081120554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081120554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081120555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081120555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081120556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081120556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081120556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:22.096663 run osmo-stp_10.42.42.5(pid=27098): stdout: | (launched: 2022-12-14_08:11:20.363698) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:22.228159 run osmo-stp_10.42.42.5(pid=27098): stderr: | 20221214081120554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081120554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081120555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081120555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081120556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081120556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081120556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:22.384320 run patchelf(pid=27101): Terminating (SIGINT) 08:11:22.565749 run patchelf(pid=27101): Terminated: ok {rc=0} 08:11:22.697727 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27098): Process ended prematurely: osmo-stp_10.42.42.5(pid=27098) [trial-2401↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27098)] [trial-2401↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:11:22.707297 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 08:11:22.735216 run osmo-hlr_10.42.42.2(pid=27095): ERR: Terminated: ERROR {rc=237} [trial-2401↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27095)] 08:11:22.785365 run osmo-hlr_10.42.42.2(pid=27095): stdout: | (launched: 2022-12-14_08:11:19.358333) 08:11:22.837562 run osmo-hlr_10.42.42.2(pid=27095): stderr: | 20221214081119555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081119555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081119555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081119555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081119555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081119555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081119573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081119583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081119584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081119584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:22.890284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27094): Terminating (SIGTERM) 08:11:22.932036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27097): Terminating (SIGTERM) 08:11:22.973963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27100): Terminating (SIGTERM) 08:11:23.016482 --- ParallelTerminationStrategy: PID 27094 died... 08:11:23.036675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27094): Terminated: ok {rc=0} 08:11:23.082855 --- ParallelTerminationStrategy: PID 27097 died... 08:11:23.102548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27097): Terminated: ok {rc=0} 08:11:23.148402 --- ParallelTerminationStrategy: PID 27100 died... 08:11:23.168041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27100): Terminated: ok {rc=0} 08:11:23.256682 bus /gobi_0: Setting Powered False 08:11:24.355439 bus /gobi_0: Setting Powered False 08:11:25.471088 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2401 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 nitb_smpp --------------------------------------------------------------------- 08:11:26.736299 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:11:26.739052 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 08:11:26.760095 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 08:11:26.767096 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 08:11:26.807099 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 08:11:26.828868 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 08:11:26.835531 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 08:11:27.350748 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2401 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 08:11:27.355753 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:11:27.377633 tst esme_connect_policy_acceptall.py: using MSISDN 8578 08:11:27.514338 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:11:28.091435 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27105): Launched 08:11:28.401297 run osmo-nitb_10.42.42.2(pid=27106): Launched 08:11:28.571601 run osmo-nitb_10.42.42.2(pid=27106): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27106)] 08:11:28.709422 run osmo-nitb_10.42.42.2(pid=27106): stdout: | (launched: 2022-12-14_08:11:28.345071) 08:11:28.848046 run osmo-nitb_10.42.42.2(pid=27106): stderr: | (launched: 2022-12-14_08:11:28.390438) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:11:28.987028 run osmo-nitb_10.42.42.2(pid=27106): stdout: | (launched: 2022-12-14_08:11:28.345071) 08:11:29.119776 run osmo-nitb_10.42.42.2(pid=27106): stderr: | (launched: 2022-12-14_08:11:28.390438) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27106): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27106) [trial-2401↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27106)] 08:11:29.517798 tst osmo-nitb_10.42.42.2(pid=27106): stdout: | (launched: 2022-12-14_08:11:28.345071) 08:11:29.641908 tst osmo-nitb_10.42.42.2(pid=27106): stderr: | (launched: 2022-12-14_08:11:28.390438) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:11:29.789433 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=27106): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27106) [trial-2401↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27106)] [trial-2401↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 08:11:29.797597 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 08:11:29.804146 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27105): Terminating (SIGTERM) 08:11:30.012605 --- ParallelTerminationStrategy: PID 27105 died... 08:11:30.033109 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27105): Terminated: ok {rc=0} ---------------------------------------------- trial-2401 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 08:11:30.081212 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:11:30.102871 tst esme_connect_policy_closed.py: using MSISDN 8579 08:11:30.225894 tst esme_connect_policy_closed.py: using MSISDN 8580 08:11:30.347350 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:11:30.922450 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27107): Launched 08:11:31.289894 run osmo-nitb_10.42.42.2(pid=27108): Launched 08:11:31.492338 run osmo-nitb_10.42.42.2(pid=27108): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27108)] 08:11:31.633650 run osmo-nitb_10.42.42.2(pid=27108): stdout: | (launched: 2022-12-14_08:11:31.229633) 08:11:31.775794 run osmo-nitb_10.42.42.2(pid=27108): stderr: | (launched: 2022-12-14_08:11:31.279611) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:11:31.918254 run osmo-nitb_10.42.42.2(pid=27108): stdout: | (launched: 2022-12-14_08:11:31.229633) 08:11:32.053955 run osmo-nitb_10.42.42.2(pid=27108): stderr: | (launched: 2022-12-14_08:11:31.279611) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:11:32.215402 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=27108): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27108) [trial-2401↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27108)] [trial-2401↪nitb_smpp↪esme_connect_policy_closed.py:24] 08:11:32.224679 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 08:11:32.232174 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27107): Terminating (SIGTERM) 08:11:32.444721 --- ParallelTerminationStrategy: PID 27107 died... 08:11:32.466300 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27107): Terminated: ok {rc=0} ---------------------------------------------- trial-2401 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 08:11:32.518641 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:11:32.530502 tst nitb_smpp: Using 1 x bts (candidates: 1) 08:11:32.567454 tst esme_ms_sms_storeforward.py: using LAC 39576 08:11:32.691673 tst esme_ms_sms_storeforward.py: using RAC 51 08:11:32.815083 tst esme_ms_sms_storeforward.py: using CellId 39576 08:11:32.946933 tst esme_ms_sms_storeforward.py: using BVCI 39577 08:11:33.067524 tst nitb_smpp: Using 1 x modem (candidates: 1) 08:11:33.196590 tst esme_ms_sms_storeforward.py: using MSISDN 8581 08:11:33.317860 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 08:11:33.543175 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:11:34.219893 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27109): Launched 08:11:34.552162 run osmo-nitb_10.42.42.2(pid=27110): Launched 08:11:34.732146 run osmo-nitb_10.42.42.2(pid=27110): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27110)] 08:11:34.868356 run osmo-nitb_10.42.42.2(pid=27110): stdout: | (launched: 2022-12-14_08:11:34.491668) 08:11:35.005994 run osmo-nitb_10.42.42.2(pid=27110): stderr: | (launched: 2022-12-14_08:11:34.541184) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:11:35.143447 run osmo-nitb_10.42.42.2(pid=27110): stdout: | (launched: 2022-12-14_08:11:34.491668) 08:11:35.274720 run osmo-nitb_10.42.42.2(pid=27110): stderr: | (launched: 2022-12-14_08:11:34.541184) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:11:35.432793 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=27110): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27110) [trial-2401↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27110)] [trial-2401↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 08:11:35.441764 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 08:11:35.448722 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27109): Terminating (SIGTERM) 08:11:35.659686 --- ParallelTerminationStrategy: PID 27109 died... 08:11:35.681176 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27109): Terminated: ok {rc=0} 08:11:35.769854 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 08:11:36.857756 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:11:36.869596 tst nitb_smpp: Using 1 x bts (candidates: 1) 08:11:36.906089 tst esme_ms_sms_transaction.py: using LAC 39577 08:11:37.037345 tst esme_ms_sms_transaction.py: using RAC 52 08:11:37.169639 tst esme_ms_sms_transaction.py: using CellId 39577 08:11:37.298994 tst esme_ms_sms_transaction.py: using BVCI 39578 08:11:37.420838 tst nitb_smpp: Using 1 x modem (candidates: 1) 08:11:37.561718 tst esme_ms_sms_transaction.py: using MSISDN 8582 08:11:37.674765 tst esme_ms_sms_transaction.py:18: start nitb and bts... 08:11:37.884299 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:11:38.510864 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27111): Launched 08:11:38.820748 run osmo-nitb_10.42.42.2(pid=27112): Launched 08:11:38.991432 run osmo-nitb_10.42.42.2(pid=27112): ERR: Terminated: ERROR {rc=2} [trial-2401↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27112)] 08:11:39.129094 run osmo-nitb_10.42.42.2(pid=27112): stdout: | (launched: 2022-12-14_08:11:38.764284) 08:11:39.267711 run osmo-nitb_10.42.42.2(pid=27112): stderr: | (launched: 2022-12-14_08:11:38.809986) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:11:39.406746 run osmo-nitb_10.42.42.2(pid=27112): stdout: | (launched: 2022-12-14_08:11:38.764284) 08:11:39.539493 run osmo-nitb_10.42.42.2(pid=27112): stderr: | (launched: 2022-12-14_08:11:38.809986) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fd5995fe268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27112): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27112) [trial-2401↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27112)] 08:11:39.937223 tst osmo-nitb_10.42.42.2(pid=27112): stdout: | (launched: 2022-12-14_08:11:38.764284) 08:11:40.061717 tst osmo-nitb_10.42.42.2(pid=27112): stderr: | (launched: 2022-12-14_08:11:38.809986) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:11:40.208497 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=27112): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27112) [trial-2401↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27112)] [trial-2401↪nitb_smpp↪esme_ms_sms_transaction.py:21] 08:11:40.217039 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 08:11:40.223556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27111): Terminating (SIGTERM) 08:11:40.431902 --- ParallelTerminationStrategy: PID 27111 died... 08:11:40.452357 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27111): Terminated: ok {rc=0} 08:11:40.538859 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 smpp --------------------------------------------------------------------- 08:11:41.707256 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:11:41.710373 tst smpp: Verifying 1 x bts (candidates: 11) 08:11:41.731152 tst smpp: Verifying 6 x ip_address (candidates: 9) 08:11:41.758121 tst smpp: Verifying 1 x modem (candidates: 12) 08:11:41.793785 tst smpp: Reserving 1 x bts (candidates: 11) 08:11:41.814537 tst smpp: Reserving 6 x ip_address (candidates: 9) 08:11:41.840789 tst smpp: Reserving 1 x modem (candidates: 12) 08:11:42.367204 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 08:11:42.372061 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:42.382555 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:42.392788 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:42.403085 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:42.421473 tst esme_connect_policy_acceptall.py: using MSISDN 8583 08:11:42.535090 run osmo-stp_10.42.42.4: Starting osmo-stp 08:11:43.063025 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27116): Launched 08:11:43.371054 run osmo-stp_10.42.42.4(pid=27117): Launched 08:11:43.488622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:43.967164 run create_hlr_db(pid=27118): Launched 08:11:44.093180 bus /sierra_2: Setting Powered False 08:11:45.154158 run create_hlr_db(pid=27118): Terminated: ok {rc=0} 08:11:45.583786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27120): Launched 08:11:45.926251 run osmo-hlr_10.42.42.2(pid=27121): Launched 08:11:46.195965 run osmo-msc_10.42.42.5: Starting osmo-msc 08:11:46.951770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27123): Launched 08:11:47.281546 run osmo-msc_10.42.42.5(pid=27124): Launched 08:11:47.491465 run osmo-hlr_10.42.42.2(pid=27121): ERR: Terminated: ERROR {rc=237} [trial-2401↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27121)] 08:11:47.635642 run osmo-hlr_10.42.42.2(pid=27121): stdout: | (launched: 2022-12-14_08:11:45.839023) 08:11:47.783055 run osmo-hlr_10.42.42.2(pid=27121): stderr: | 20221214081146074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081146074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081146074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081146074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081146074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081146074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081146093 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081146116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081146116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081146116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:47.918413 run osmo-hlr_10.42.42.2(pid=27121): stdout: | (launched: 2022-12-14_08:11:45.839023) 08:11:48.040232 run osmo-hlr_10.42.42.2(pid=27121): stderr: | 20221214081146074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081146074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081146074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081146074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081146074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081146074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081146093 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081146116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081146116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081146116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:48.187035 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=27121): Process ended prematurely: osmo-hlr_10.42.42.2(pid=27121) [trial-2401↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27121)] [trial-2401↪smpp↪esme_connect_policy_acceptall.py:23] 08:11:48.195579 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.8 sec) 08:11:48.221699 run osmo-msc_10.42.42.5(pid=27124): ERR: Terminated: ERROR {rc=9} [trial-2401↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=27124)] 08:11:48.269563 run osmo-msc_10.42.42.5(pid=27124): stdout: | (launched: 2022-12-14_08:11:47.223855) 08:11:48.319351 run osmo-msc_10.42.42.5(pid=27124): stderr: | 20221214081147604 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214081147604 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214081147604 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081147604 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214081147604 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214081147604 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214081147604 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214081147604 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214081147604 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 08:11:48.369346 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27116): Terminating (SIGTERM) 08:11:48.409140 run osmo-stp_10.42.42.4(pid=27117): Terminating (SIGTERM) 08:11:48.449067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27120): Terminating (SIGTERM) 08:11:48.490431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27123): Terminating (SIGTERM) 08:11:48.532779 --- ParallelTerminationStrategy: PID 27116 died... 08:11:48.551742 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27116): Terminated: ok {rc=0} 08:11:48.596459 --- ParallelTerminationStrategy: PID 27117 died... 08:11:48.615060 run osmo-stp_10.42.42.4(pid=27117): Terminated: ok {rc=0} 08:11:48.658957 --- ParallelTerminationStrategy: PID 27120 died... 08:11:48.677710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27120): Terminated: ok {rc=0} 08:11:48.721825 --- ParallelTerminationStrategy: PID 27123 died... 08:11:48.740277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27123): Terminated: ok {rc=0} ---------------------------------------------- trial-2401 smpp esme_connect_policy_closed.py ---------------------------------------------- 08:11:48.788660 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:48.799940 tst smpp: Using 1 x bts (candidates: 1) 08:11:48.835830 tst esme_connect_policy_closed.py: using LAC 39578 08:11:48.957594 tst esme_connect_policy_closed.py: using RAC 53 08:11:49.078265 tst esme_connect_policy_closed.py: using CellId 39578 08:11:49.201271 tst esme_connect_policy_closed.py: using BVCI 39579 08:11:49.313255 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:49.323717 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:49.334129 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:49.353584 tst esme_connect_policy_closed.py: using MSISDN 8584 08:11:49.474882 tst esme_connect_policy_closed.py: using MSISDN 8585 08:11:49.588098 run osmo-stp_10.42.42.4: Starting osmo-stp 08:11:50.117496 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27127): Launched 08:11:50.429364 run osmo-stp_10.42.42.4(pid=27128): Launched 08:11:50.547998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:51.029647 run create_hlr_db(pid=27129): Launched 08:11:52.212382 run create_hlr_db(pid=27129): Terminated: ok {rc=0} 08:11:52.537967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27131): Launched 08:11:52.847301 run osmo-hlr_10.42.42.2(pid=27132): Launched 08:11:52.965136 run osmo-msc_10.42.42.5: Starting osmo-msc 08:11:53.525191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27134): Launched 08:11:53.834879 run osmo-msc_10.42.42.5(pid=27135): Launched 08:11:54.008101 run osmo-hlr_10.42.42.2(pid=27132): ERR: Terminated: ERROR {rc=237} [trial-2401↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27132)] 08:11:54.140117 run osmo-hlr_10.42.42.2(pid=27132): stdout: | (launched: 2022-12-14_08:11:52.790514) 08:11:54.270920 run osmo-hlr_10.42.42.2(pid=27132): stderr: | 20221214081152966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081152966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081152967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081152967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081152967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081152967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081152980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081152991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081152991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081152991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:54.399387 run osmo-hlr_10.42.42.2(pid=27132): stdout: | (launched: 2022-12-14_08:11:52.790514) 08:11:54.522099 run osmo-hlr_10.42.42.2(pid=27132): stderr: | 20221214081152966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081152966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081152967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081152967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081152967 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081152967 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081152980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081152991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081152991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081152991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:54.669240 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=27132): Process ended prematurely: osmo-hlr_10.42.42.2(pid=27132) [trial-2401↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27132)] [trial-2401↪smpp↪esme_connect_policy_closed.py:31] 08:11:54.677456 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 08:11:54.703443 run osmo-msc_10.42.42.5(pid=27135): ERR: Terminated: ERROR {rc=9} [trial-2401↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=27135)] 08:11:54.751813 run osmo-msc_10.42.42.5(pid=27135): stdout: | (launched: 2022-12-14_08:11:53.778018) 08:11:54.801219 run osmo-msc_10.42.42.5(pid=27135): stderr: | 20221214081154095 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214081154095 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214081154095 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081154095 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214081154095 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214081154096 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214081154096 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214081154096 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214081154096 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 08:11:54.850797 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27127): Terminating (SIGTERM) 08:11:54.890643 run osmo-stp_10.42.42.4(pid=27128): Terminating (SIGTERM) 08:11:54.930423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27131): Terminating (SIGTERM) 08:11:54.972010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27134): Terminating (SIGTERM) 08:11:55.013377 --- ParallelTerminationStrategy: PID 27127 died... 08:11:55.032810 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27127): Terminated: ok {rc=0} 08:11:55.076553 --- ParallelTerminationStrategy: PID 27128 died... 08:11:55.094931 run osmo-stp_10.42.42.4(pid=27128): Terminated: ok {rc=0} 08:11:55.138240 --- ParallelTerminationStrategy: PID 27131 died... 08:11:55.156645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27131): Terminated: ok {rc=0} 08:11:55.199980 --- ParallelTerminationStrategy: PID 27134 died... 08:11:55.218605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27134): Terminated: ok {rc=0} ---------------------------------------------- trial-2401 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 08:11:55.266857 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:55.278113 tst smpp: Using 1 x bts (candidates: 1) 08:11:55.317764 tst esme_ms_sms_storeforward.py: using LAC 39579 08:11:55.451498 tst esme_ms_sms_storeforward.py: using RAC 54 08:11:55.583348 tst esme_ms_sms_storeforward.py: using CellId 39579 08:11:55.716452 tst esme_ms_sms_storeforward.py: using BVCI 39580 08:11:55.838172 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:55.849484 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:55.860345 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:55.871355 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:55.882884 tst smpp: Using 1 x ip_address (candidates: 6) 08:11:55.894318 tst smpp: Using 1 x modem (candidates: 1) 08:11:56.025636 tst esme_ms_sms_storeforward.py: using MSISDN 8586 08:11:56.139382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:56.618896 run create_hlr_db(pid=27138): Launched 08:11:57.803047 run create_hlr_db(pid=27138): Terminated: ok {rc=0} 08:11:58.130992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27140): Launched 08:11:58.464674 run osmo-hlr_10.42.42.2(pid=27141): Launched 08:11:58.593408 run osmo-stp_10.42.42.5: Starting osmo-stp 08:11:59.169516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27143): Launched 08:11:59.504799 run osmo-stp_10.42.42.5(pid=27144): Launched 08:11:59.633038 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:00.232629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27146): Launched 08:12:00.565533 run osmo-msc_10.42.42.6(pid=27147): Launched 08:12:00.753490 run osmo-stp_10.42.42.5(pid=27144): ERR: Terminated: ERROR {rc=1} [trial-2401↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27144)] 08:12:00.946087 run osmo-stp_10.42.42.5(pid=27144): stdout: | (launched: 2022-12-14_08:11:59.443688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:01.183143 run osmo-stp_10.42.42.5(pid=27144): stderr: | 20221214081159637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081159637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081159637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081159637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081159638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081159638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081159638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:01.324370 run osmo-stp_10.42.42.5(pid=27144): stdout: | (launched: 2022-12-14_08:11:59.443688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:01.459692 run osmo-stp_10.42.42.5(pid=27144): stderr: | 20221214081159637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081159637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081159637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081159637 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081159638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081159638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081159638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:01.622297 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=27144): Process ended prematurely: osmo-stp_10.42.42.5(pid=27144) [trial-2401↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27144)] [trial-2401↪smpp↪esme_ms_sms_storeforward.py:30] 08:12:01.632853 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.4 sec) 08:12:01.661763 run osmo-hlr_10.42.42.2(pid=27141): ERR: Terminated: ERROR {rc=237} [trial-2401↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27141)] 08:12:01.720287 run osmo-hlr_10.42.42.2(pid=27141): stdout: | (launched: 2022-12-14_08:11:58.403909) 08:12:01.781315 run osmo-hlr_10.42.42.2(pid=27141): stderr: | 20221214081158602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081158602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081158602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081158602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081158602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081158602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081158614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081158623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081158623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081158623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:01.866930 run osmo-msc_10.42.42.6(pid=27147): ERR: Terminated: ERROR {rc=2} [trial-2401↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27147)] 08:12:01.927323 run osmo-msc_10.42.42.6(pid=27147): stdout: | (launched: 2022-12-14_08:12:00.504524) 08:12:01.989862 run osmo-msc_10.42.42.6(pid=27147): stderr: | 20221214081200824 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081200824 DLGLOBAL DEBUG validating counter group 0x7fdf70923c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081200824 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081200825 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081200825 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081200825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081200827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081200827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081200828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081200828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:02.045870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27140): Terminating (SIGTERM) 08:12:02.089966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27143): Terminating (SIGTERM) 08:12:02.134932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27146): Terminating (SIGTERM) 08:12:02.180189 --- ParallelTerminationStrategy: PID 27140 died... 08:12:02.200282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27140): Terminated: ok {rc=0} 08:12:02.245627 --- ParallelTerminationStrategy: PID 27143 died... 08:12:02.265138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27143): Terminated: ok {rc=0} 08:12:02.309945 --- ParallelTerminationStrategy: PID 27146 died... 08:12:02.329082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27146): Terminated: ok {rc=0} 08:12:02.421148 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 smpp esme_ms_sms_transaction.py ---------------------------------------------- 08:12:03.511088 tst smpp: Using 1 x ip_address (candidates: 6) 08:12:03.523426 tst smpp: Using 1 x bts (candidates: 1) 08:12:03.561588 tst esme_ms_sms_transaction.py: using LAC 39580 08:12:03.694380 tst esme_ms_sms_transaction.py: using RAC 55 08:12:03.827227 tst esme_ms_sms_transaction.py: using CellId 39580 08:12:03.956841 tst esme_ms_sms_transaction.py: using BVCI 39581 08:12:04.077473 tst smpp: Using 1 x ip_address (candidates: 6) 08:12:04.088587 tst smpp: Using 1 x ip_address (candidates: 6) 08:12:04.099578 tst smpp: Using 1 x ip_address (candidates: 6) 08:12:04.110478 tst smpp: Using 1 x ip_address (candidates: 6) 08:12:04.121754 tst smpp: Using 1 x ip_address (candidates: 6) 08:12:04.132904 tst smpp: Using 1 x modem (candidates: 1) 08:12:04.262243 tst esme_ms_sms_transaction.py: using MSISDN 8587 08:12:04.376398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:04.854890 run create_hlr_db(pid=27149): Launched 08:12:04.983506 bus /sierra_2: Setting Powered False 08:12:06.044897 run create_hlr_db(pid=27149): Terminated: ok {rc=0} 08:12:06.478604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27151): Launched 08:12:06.789339 run osmo-hlr_10.42.42.2(pid=27152): Launched 08:12:06.906676 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:07.453342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27154): Launched 08:12:07.762740 run osmo-stp_10.42.42.5(pid=27155): Launched 08:12:07.880235 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:08.437264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27157): Launched 08:12:08.746312 run osmo-msc_10.42.42.6(pid=27158): Launched 08:12:08.921866 run osmo-stp_10.42.42.5(pid=27155): ERR: Terminated: ERROR {rc=1} [trial-2401↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27155)] 08:12:09.052148 run osmo-stp_10.42.42.5(pid=27155): stdout: | (launched: 2022-12-14_08:12:07.706040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:09.181982 run osmo-stp_10.42.42.5(pid=27155): stderr: | 20221214081207877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081207877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081207877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081207878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081207878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081207878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081207878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:09.309950 run osmo-stp_10.42.42.5(pid=27155): stdout: | (launched: 2022-12-14_08:12:07.706040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:09.432257 run osmo-stp_10.42.42.5(pid=27155): stderr: | 20221214081207877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081207877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081207877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081207878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081207878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081207878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081207878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:09.578766 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=27155): Process ended prematurely: osmo-stp_10.42.42.5(pid=27155) [trial-2401↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27155)] [trial-2401↪smpp↪esme_ms_sms_transaction.py:28] 08:12:09.587055 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec) 08:12:09.612897 run osmo-hlr_10.42.42.2(pid=27152): ERR: Terminated: ERROR {rc=237} [trial-2401↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27152)] 08:12:09.661123 run osmo-hlr_10.42.42.2(pid=27152): stdout: | (launched: 2022-12-14_08:12:06.732129) 08:12:09.710415 run osmo-hlr_10.42.42.2(pid=27152): stderr: | 20221214081206908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081206908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081206908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081206908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081206908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081206908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081206920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081206928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081206929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081206929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:09.778856 run osmo-msc_10.42.42.6(pid=27158): ERR: Terminated: ERROR {rc=2} [trial-2401↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27158)] 08:12:09.825930 run osmo-msc_10.42.42.6(pid=27158): stdout: | (launched: 2022-12-14_08:12:08.689164) 08:12:09.874517 run osmo-msc_10.42.42.6(pid=27158): stderr: | 20221214081208962 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081208962 DLGLOBAL DEBUG validating counter group 0x7f7ac542ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081208962 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081208962 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081208962 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081208962 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081208964 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081208965 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081208965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081208965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:09.923726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27151): Terminating (SIGTERM) 08:12:09.963705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27154): Terminating (SIGTERM) 08:12:10.003127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27157): Terminating (SIGTERM) 08:12:10.043385 --- ParallelTerminationStrategy: PID 27151 died... 08:12:10.062493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27151): Terminated: ok {rc=0} 08:12:10.106253 --- ParallelTerminationStrategy: PID 27154 died... 08:12:10.124548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27154): Terminated: ok {rc=0} 08:12:10.168103 --- ParallelTerminationStrategy: PID 27157 died... 08:12:10.186583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27157): Terminated: ok {rc=0} 08:12:10.271854 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 encryption --------------------------------------------------------------------- 08:12:11.466096 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:12:11.469522 tst encryption: Verifying 1 x bts (candidates: 11) 08:12:11.490532 tst encryption: Verifying 6 x ip_address (candidates: 9) 08:12:11.517512 tst encryption: Verifying 1 x modem (candidates: 12) 08:12:11.552207 tst encryption: Reserving 1 x bts (candidates: 11) 08:12:11.573070 tst encryption: Reserving 6 x ip_address (candidates: 9) 08:12:11.599257 tst encryption: Reserving 1 x modem (candidates: 12) 08:12:12.127619 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2401 encryption register_a5_0_authopt.py ---------------------------------------------- 08:12:12.181307 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:12.191963 tst encryption: Using 1 x bts (candidates: 1) 08:12:12.227504 tst register_a5_0_authopt.py: using LAC 39581 08:12:12.351967 tst register_a5_0_authopt.py: using RAC 56 08:12:12.476742 tst register_a5_0_authopt.py: using CellId 39581 08:12:12.599702 tst register_a5_0_authopt.py: using BVCI 39582 08:12:12.715865 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:12.726601 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:12.737227 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:12.747537 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:12.758043 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:12.768398 tst encryption: Using 1 x modem (candidates: 1) 08:12:12.885490 tst register_a5_0_authopt.py:8: start network... 08:12:13.096793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:13.582658 run create_hlr_db(pid=27163): Launched 08:12:13.713350 bus /sierra_2: Setting Powered False 08:12:14.778782 run create_hlr_db(pid=27163): Terminated: ok {rc=0} 08:12:15.247705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27165): Launched 08:12:15.586970 run osmo-hlr_10.42.42.2(pid=27166): Launched 08:12:15.718094 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:16.305694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27168): Launched 08:12:16.635174 run osmo-stp_10.42.42.5(pid=27169): Launched 08:12:16.809496 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:17.517891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27171): Launched 08:12:17.833095 run osmo-msc_10.42.42.6(pid=27172): Launched 08:12:18.007866 run osmo-stp_10.42.42.5(pid=27169): ERR: Terminated: ERROR {rc=1} [trial-2401↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27169)] 08:12:18.140547 run osmo-stp_10.42.42.5(pid=27169): stdout: | (launched: 2022-12-14_08:12:16.576866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:18.271838 run osmo-stp_10.42.42.5(pid=27169): stderr: | 20221214081216934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081216934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081216940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081216940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081216941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081216941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081216941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:18.401988 run osmo-stp_10.42.42.5(pid=27169): stdout: | (launched: 2022-12-14_08:12:16.576866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:18.526222 run osmo-stp_10.42.42.5(pid=27169): stderr: | 20221214081216934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081216934 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081216940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081216940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081216941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081216941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081216941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:18.675117 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27169): Process ended prematurely: osmo-stp_10.42.42.5(pid=27169) [trial-2401↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27169)] [trial-2401↪encryption↪register_a5_0_authopt.py:8] 08:12:18.684036 tst register_a5_0_authopt.py:8: Test FAILED (6.5 sec) 08:12:18.710570 run osmo-hlr_10.42.42.2(pid=27166): ERR: Terminated: ERROR {rc=237} [trial-2401↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27166)] 08:12:18.758490 run osmo-hlr_10.42.42.2(pid=27166): stdout: | (launched: 2022-12-14_08:12:15.525831) 08:12:18.808266 run osmo-hlr_10.42.42.2(pid=27166): stderr: | 20221214081215723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081215723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081215723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081215723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081215723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081215723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081215734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081215742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081215742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081215743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:18.877422 run osmo-msc_10.42.42.6(pid=27172): ERR: Terminated: ERROR {rc=2} [trial-2401↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27172)] 08:12:18.925144 run osmo-msc_10.42.42.6(pid=27172): stdout: | (launched: 2022-12-14_08:12:17.775233) 08:12:18.974493 run osmo-msc_10.42.42.6(pid=27172): stderr: | 20221214081218047 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081218047 DLGLOBAL DEBUG validating counter group 0x7f10809f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081218047 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081218047 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081218048 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081218048 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081218049 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081218050 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081218050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081218050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:19.024239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27165): Terminating (SIGTERM) 08:12:19.064125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27168): Terminating (SIGTERM) 08:12:19.104038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27171): Terminating (SIGTERM) 08:12:19.144122 --- ParallelTerminationStrategy: PID 27165 died... 08:12:19.163553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27165): Terminated: ok {rc=0} 08:12:19.207733 --- ParallelTerminationStrategy: PID 27168 died... 08:12:19.226469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27168): Terminated: ok {rc=0} 08:12:19.270367 --- ParallelTerminationStrategy: PID 27171 died... 08:12:19.289101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27171): Terminated: ok {rc=0} 08:12:19.375224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 encryption register_a5_0_authreq.py ---------------------------------------------- 08:12:20.525055 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:20.536305 tst encryption: Using 1 x bts (candidates: 1) 08:12:20.572438 tst register_a5_0_authreq.py: using LAC 39582 08:12:20.696823 tst register_a5_0_authreq.py: using RAC 57 08:12:20.821289 tst register_a5_0_authreq.py: using CellId 39582 08:12:20.945271 tst register_a5_0_authreq.py: using BVCI 39583 08:12:21.067917 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:21.079301 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:21.090551 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:21.101789 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:21.113009 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:21.124311 tst encryption: Using 1 x modem (candidates: 1) 08:12:21.247892 tst register_a5_0_authreq.py:8: start network... 08:12:21.475711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:21.995663 run create_hlr_db(pid=27174): Launched 08:12:22.124604 bus /sierra_2: Setting Powered False 08:12:23.190893 run create_hlr_db(pid=27174): Terminated: ok {rc=0} 08:12:23.658439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27176): Launched 08:12:23.996139 run osmo-hlr_10.42.42.2(pid=27177): Launched 08:12:24.125221 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:24.706581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27179): Launched 08:12:25.044158 run osmo-stp_10.42.42.5(pid=27180): Launched 08:12:25.173085 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:25.779696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27182): Launched 08:12:26.119577 run osmo-msc_10.42.42.6(pid=27183): Launched 08:12:26.309658 run osmo-stp_10.42.42.5(pid=27180): ERR: Terminated: ERROR {rc=1} [trial-2401↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27180)] 08:12:26.450650 run osmo-stp_10.42.42.5(pid=27180): stdout: | (launched: 2022-12-14_08:12:24.983134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:26.592396 run osmo-stp_10.42.42.5(pid=27180): stderr: | 20221214081225175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081225175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081225175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081225176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081225176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081225176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081225176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:26.732263 run osmo-stp_10.42.42.5(pid=27180): stdout: | (launched: 2022-12-14_08:12:24.983134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:26.865334 run osmo-stp_10.42.42.5(pid=27180): stderr: | 20221214081225175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081225175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081225175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081225176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081225176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081225176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081225176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:27.024913 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27180): Process ended prematurely: osmo-stp_10.42.42.5(pid=27180) [trial-2401↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27180)] [trial-2401↪encryption↪register_a5_0_authreq.py:8] 08:12:27.034701 tst register_a5_0_authreq.py:8: Test FAILED (6.5 sec) 08:12:27.062524 run osmo-hlr_10.42.42.2(pid=27177): ERR: Terminated: ERROR {rc=237} [trial-2401↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27177)] 08:12:27.113360 run osmo-hlr_10.42.42.2(pid=27177): stdout: | (launched: 2022-12-14_08:12:23.934863) 08:12:27.165555 run osmo-hlr_10.42.42.2(pid=27177): stderr: | 20221214081224135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081224135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081224135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081224135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081224135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081224135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081224147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081224155 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081224156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081224156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:27.238113 run osmo-msc_10.42.42.6(pid=27183): ERR: Terminated: ERROR {rc=2} [trial-2401↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27183)] 08:12:27.287929 run osmo-msc_10.42.42.6(pid=27183): stdout: | (launched: 2022-12-14_08:12:26.058083) 08:12:27.340344 run osmo-msc_10.42.42.6(pid=27183): stderr: | 20221214081226381 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081226381 DLGLOBAL DEBUG validating counter group 0x7f4d92171c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081226381 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081226381 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081226381 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081226381 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081226383 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081226383 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081226384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081226384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:27.392784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27176): Terminating (SIGTERM) 08:12:27.434721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27179): Terminating (SIGTERM) 08:12:27.477424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27182): Terminating (SIGTERM) 08:12:27.519796 --- ParallelTerminationStrategy: PID 27176 died... 08:12:27.540111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27176): Terminated: ok {rc=0} 08:12:27.586753 --- ParallelTerminationStrategy: PID 27179 died... 08:12:27.606560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27179): Terminated: ok {rc=0} 08:12:27.653303 --- ParallelTerminationStrategy: PID 27182 died... 08:12:27.673216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27182): Terminated: ok {rc=0} 08:12:27.762655 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 encryption register_a5_1_authreq.py ---------------------------------------------- 08:12:28.915568 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:28.927442 tst encryption: Using 1 x bts (candidates: 1) 08:12:28.965205 tst register_a5_1_authreq.py: using LAC 39583 08:12:29.096675 tst register_a5_1_authreq.py: using RAC 58 08:12:29.228890 tst register_a5_1_authreq.py: using CellId 39583 08:12:29.353140 tst register_a5_1_authreq.py: using BVCI 39584 08:12:29.468849 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:29.479714 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:29.490480 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:29.500936 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:29.511492 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:29.521876 tst encryption: Using 1 x modem (candidates: 1) 08:12:29.639731 tst register_a5_1_authreq.py:8: start network... 08:12:29.851680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:30.340456 run create_hlr_db(pid=27185): Launched 08:12:30.468908 bus /sierra_2: Setting Powered False 08:12:31.547296 run create_hlr_db(pid=27185): Terminated: ok {rc=0} 08:12:32.066270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27187): Launched 08:12:32.397458 run osmo-hlr_10.42.42.2(pid=27188): Launched 08:12:32.518689 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:33.074508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27190): Launched 08:12:33.389295 run osmo-stp_10.42.42.5(pid=27191): Launched 08:12:33.508846 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:34.074208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27193): Launched 08:12:34.390808 run osmo-msc_10.42.42.6(pid=27194): Launched 08:12:34.568823 run osmo-stp_10.42.42.5(pid=27191): ERR: Terminated: ERROR {rc=1} [trial-2401↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27191)] 08:12:34.701433 run osmo-stp_10.42.42.5(pid=27191): stdout: | (launched: 2022-12-14_08:12:33.331492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:34.833081 run osmo-stp_10.42.42.5(pid=27191): stderr: | 20221214081233502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081233502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081233503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081233503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081233504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081233504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081233504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:34.962879 run osmo-stp_10.42.42.5(pid=27191): stdout: | (launched: 2022-12-14_08:12:33.331492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:35.086984 run osmo-stp_10.42.42.5(pid=27191): stderr: | 20221214081233502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081233502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081233503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081233503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081233504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081233504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081233504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:35.235686 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27191): Process ended prematurely: osmo-stp_10.42.42.5(pid=27191) [trial-2401↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27191)] [trial-2401↪encryption↪register_a5_1_authreq.py:8] 08:12:35.244440 tst register_a5_1_authreq.py:8: Test FAILED (6.4 sec) 08:12:35.270587 run osmo-hlr_10.42.42.2(pid=27188): ERR: Terminated: ERROR {rc=237} [trial-2401↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27188)] 08:12:35.317923 run osmo-hlr_10.42.42.2(pid=27188): stdout: | (launched: 2022-12-14_08:12:32.339084) 08:12:35.367319 run osmo-hlr_10.42.42.2(pid=27188): stderr: | 20221214081232514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081232514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081232515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081232515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081232515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081232515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081232527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081232537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081232537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081232537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:35.436378 run osmo-msc_10.42.42.6(pid=27194): ERR: Terminated: ERROR {rc=2} [trial-2401↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27194)] 08:12:35.483690 run osmo-msc_10.42.42.6(pid=27194): stdout: | (launched: 2022-12-14_08:12:34.332929) 08:12:35.533116 run osmo-msc_10.42.42.6(pid=27194): stderr: | 20221214081234605 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081234605 DLGLOBAL DEBUG validating counter group 0x7fe6f38cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081234605 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081234606 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081234606 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081234606 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081234608 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081234608 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081234608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081234608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:35.582689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27187): Terminating (SIGTERM) 08:12:35.622397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27190): Terminating (SIGTERM) 08:12:35.662410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27193): Terminating (SIGTERM) 08:12:35.702251 --- ParallelTerminationStrategy: PID 27187 died... 08:12:35.721315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27187): Terminated: ok {rc=0} 08:12:35.765078 --- ParallelTerminationStrategy: PID 27190 died... 08:12:35.783575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27190): Terminated: ok {rc=0} 08:12:35.827185 --- ParallelTerminationStrategy: PID 27193 died... 08:12:35.845671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27193): Terminated: ok {rc=0} 08:12:35.931362 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2401 encryption register_a5_3_authreq.py ---------------------------------------------- 08:12:37.082722 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:37.094136 tst encryption: Using 1 x bts (candidates: 1) 08:12:37.130865 tst register_a5_3_authreq.py: using LAC 39584 08:12:37.264284 tst register_a5_3_authreq.py: using RAC 59 08:12:37.396805 tst register_a5_3_authreq.py: using CellId 39584 08:12:37.521711 tst register_a5_3_authreq.py: using BVCI 39585 08:12:37.635225 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:37.646072 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:37.656685 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:37.667409 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:37.678212 tst encryption: Using 1 x ip_address (candidates: 6) 08:12:37.688761 tst encryption: Using 1 x modem (candidates: 1) 08:12:37.816652 tst register_a5_3_authreq.py:8: start network... 08:12:38.028929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:38.515100 run create_hlr_db(pid=27196): Launched 08:12:38.643390 bus /sierra_2: Setting Powered False 08:12:39.704800 run create_hlr_db(pid=27196): Terminated: ok {rc=0} 08:12:40.162841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27198): Launched 08:12:40.501435 run osmo-hlr_10.42.42.2(pid=27199): Launched 08:12:40.633336 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:41.218787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27201): Launched 08:12:41.557345 run osmo-stp_10.42.42.5(pid=27202): Launched 08:12:41.687453 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:42.295261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27204): Launched 08:12:42.634238 run osmo-msc_10.42.42.6(pid=27205): Launched 08:12:42.825562 run osmo-stp_10.42.42.5(pid=27202): ERR: Terminated: ERROR {rc=1} [trial-2401↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27202)] 08:12:42.968027 run osmo-stp_10.42.42.5(pid=27202): stdout: | (launched: 2022-12-14_08:12:41.495674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:43.109940 run osmo-stp_10.42.42.5(pid=27202): stderr: | 20221214081241688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081241688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081241688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081241689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081241689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081241689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081241689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:43.249830 run osmo-stp_10.42.42.5(pid=27202): stdout: | (launched: 2022-12-14_08:12:41.495674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:43.383534 run osmo-stp_10.42.42.5(pid=27202): stderr: | 20221214081241688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081241688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081241688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081241689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081241689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081241689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081241689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:43.543470 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27202): Process ended prematurely: osmo-stp_10.42.42.5(pid=27202) [trial-2401↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27202)] [trial-2401↪encryption↪register_a5_3_authreq.py:8] 08:12:43.553121 tst register_a5_3_authreq.py:8: Test FAILED (6.5 sec) 08:12:43.580556 run osmo-hlr_10.42.42.2(pid=27199): ERR: Terminated: ERROR {rc=237} [trial-2401↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27199)] 08:12:43.631064 run osmo-hlr_10.42.42.2(pid=27199): stdout: | (launched: 2022-12-14_08:12:40.440092) 08:12:43.683346 run osmo-hlr_10.42.42.2(pid=27199): stderr: | 20221214081240637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081240637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081240637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081240637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081240637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081240637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081240649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081240657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081240658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081240658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:43.755344 run osmo-msc_10.42.42.6(pid=27205): ERR: Terminated: ERROR {rc=2} [trial-2401↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27205)] 08:12:43.805218 run osmo-msc_10.42.42.6(pid=27205): stdout: | (launched: 2022-12-14_08:12:42.573231) 08:12:43.857295 run osmo-msc_10.42.42.6(pid=27205): stderr: | 20221214081242894 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081242894 DLGLOBAL DEBUG validating counter group 0x7f1cb8ca4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081242895 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081242895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081242895 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081242895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081242897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081242898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081242898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081242898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:43.908929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27198): Terminating (SIGTERM) 08:12:43.951005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27201): Terminating (SIGTERM) 08:12:43.993249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27204): Terminating (SIGTERM) 08:12:44.035818 --- ParallelTerminationStrategy: PID 27198 died... 08:12:44.056014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27198): Terminated: ok {rc=0} 08:12:44.102673 --- ParallelTerminationStrategy: PID 27201 died... 08:12:44.122318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27201): Terminated: ok {rc=0} 08:12:44.168220 --- ParallelTerminationStrategy: PID 27204 died... 08:12:44.187912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27204): Terminated: ok {rc=0} 08:12:44.275717 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 08:12:45.484350 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:12:45.489790 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 08:12:45.508441 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 08:12:45.537516 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 08:12:45.565055 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 08:12:45.583972 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 08:12:45.611041 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 08:12:46.136005 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2401 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 08:12:46.142533 tst handover.py:11: TEST_CONFIG: {} 08:12:46.379304 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:12:46.396650 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:12:46.422253 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:12:46.473248 tst handover.py: using MSISDN 8588 08:12:46.637235 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8588', subscriber_id=0} 08:12:46.752819 run srsepc_10.42.42.118: Starting srsepc 08:12:48.709757 run rm-remote-dir(pid=27210): Launched 08:12:48.845559 bus /sierra_2: Setting Powered False 08:12:49.915535 run rm-remote-dir(pid=27210): Terminated: ok {rc=0} 08:12:50.375607 run mk-remote-dir(pid=27211): Launched 08:12:51.559793 run mk-remote-dir(pid=27211): Terminated: ok {rc=0} 08:12:51.852560 run scp-inst-to-remote(pid=27212): Launched 08:12:54.040075 run scp-inst-to-remote(pid=27212): Terminated: ok {rc=0} 08:12:54.403102 run rm-remote-dir(pid=27214): Launched 08:12:55.597656 run rm-remote-dir(pid=27214): Terminated: ok {rc=0} 08:12:55.962193 run mk-remote-dir(pid=27215): Launched 08:12:57.157477 run mk-remote-dir(pid=27215): Terminated: ok {rc=0} 08:12:57.467274 run scp-cfg-to-remote(pid=27216): Launched 08:12:58.655545 run scp-cfg-to-remote(pid=27216): Terminated: ok {rc=0} 08:12:58.944649 run scp-db-to-remote(pid=27218): Launched 08:13:00.126249 run scp-db-to-remote(pid=27218): Terminated: ok {rc=0} 08:13:00.259260 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:13:00.573029 run patchelf(pid=27220): Launched 08:13:01.759096 run patchelf(pid=27220): Terminated: ok {rc=0} 08:13:01.897324 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:13:02.220718 run setcap-netadm(pid=27221): Launched 08:13:03.414902 run setcap-netadm(pid=27221): Terminated: ok {rc=0} 08:13:03.766147 run srsepc(pid=27222): Launched 08:13:03.890262 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:13:05.093474 run rm-remote-dir(pid=27223): Launched 08:13:05.285958 run srsepc(pid=27222): ERR: Terminated: ERROR {rc=127} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27222)] 08:13:05.432178 run srsepc(pid=27222): stdout: | (launched: 2022-12-14_08:13:03.705208) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:13:05.578670 run srsepc(pid=27222): stderr: | (launched: 2022-12-14_08:13:03.754846) | Connection to 10.42.42.116 closed. 08:13:05.725412 run srsepc(pid=27222): stdout: | (launched: 2022-12-14_08:13:03.705208) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:13:05.867123 run srsepc(pid=27222): stderr: | (launched: 2022-12-14_08:13:03.754846) | Connection to 10.42.42.116 closed. 08:13:06.034896 run rm-remote-dir(pid=27223): Terminating (SIGINT) 08:13:06.230318 run rm-remote-dir(pid=27223): Terminated: ok {rc=0} 08:13:06.371067 tst handover.py:37: ERR: Error: srsepc(pid=27222): Process ended prematurely: srsepc(pid=27222) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27222)] [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 08:13:06.381695 tst handover.py:37: Test FAILED (20.2 sec) 08:13:06.463734 run scp-back-log(pid=27224): Launched 08:13:07.546604 run scp-back-log(pid=27224): ERR: Terminated: ERROR {rc=1} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27224)] 08:13:07.610986 run scp-back-log(pid=27224): stdout: | (launched: 2022-12-14_08:13:06.431193) 08:13:07.677500 run scp-back-log(pid=27224): stderr: | (launched: 2022-12-14_08:13:06.451902) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:13:07.751856 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27224): launch_sync(): local process exited with status 1 [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27224)]') ---------------------------------------------- trial-2401 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 08:13:07.799787 tst iperf3_bidir.py:13: Number of physical ue: 1 08:13:08.025770 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:13:08.070255 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 08:13:08.277654 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:13:08.293438 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:13:08.325117 tst iperf3_bidir.py: using MSISDN 8589 08:13:08.439344 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8589', subscriber_id=0} 08:13:08.550134 run srsepc_10.42.42.118: Starting srsepc 08:13:09.192171 run rm-remote-dir(pid=27226): Launched 08:13:10.377172 run rm-remote-dir(pid=27226): Terminated: ok {rc=0} 08:13:10.718569 run mk-remote-dir(pid=27227): Launched 08:13:11.902375 run mk-remote-dir(pid=27227): Terminated: ok {rc=0} 08:13:12.192409 run scp-inst-to-remote(pid=27228): Launched 08:13:14.378305 run scp-inst-to-remote(pid=27228): Terminated: ok {rc=0} 08:13:14.742676 run rm-remote-dir(pid=27230): Launched 08:13:15.947783 run rm-remote-dir(pid=27230): Terminated: ok {rc=0} 08:13:16.299192 run mk-remote-dir(pid=27231): Launched 08:13:17.540624 run mk-remote-dir(pid=27231): Terminated: ok {rc=0} 08:13:17.831524 run scp-cfg-to-remote(pid=27232): Launched 08:13:19.012243 run scp-cfg-to-remote(pid=27232): Terminated: ok {rc=0} 08:13:19.300786 run scp-db-to-remote(pid=27234): Launched 08:13:20.484038 run scp-db-to-remote(pid=27234): Terminated: ok {rc=0} 08:13:20.617637 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:13:20.930041 run patchelf(pid=27236): Launched 08:13:22.111428 run patchelf(pid=27236): Terminated: ok {rc=0} 08:13:22.244239 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:13:22.556873 run setcap-netadm(pid=27237): Launched 08:13:23.739015 run setcap-netadm(pid=27237): Terminated: ok {rc=0} 08:13:24.067219 run srsepc(pid=27238): Launched 08:13:24.184826 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:13:25.318791 run rm-remote-dir(pid=27239): Launched 08:13:25.502791 run srsepc(pid=27238): ERR: Terminated: ERROR {rc=127} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27238)] 08:13:25.640417 run srsepc(pid=27238): stdout: | (launched: 2022-12-14_08:13:24.009873) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:13:25.777021 run srsepc(pid=27238): stderr: | (launched: 2022-12-14_08:13:24.056170) | Connection to 10.42.42.116 closed. 08:13:25.913208 run srsepc(pid=27238): stdout: | (launched: 2022-12-14_08:13:24.009873) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:13:26.044165 run srsepc(pid=27238): stderr: | (launched: 2022-12-14_08:13:24.056170) | Connection to 10.42.42.116 closed. 08:13:26.199918 run rm-remote-dir(pid=27239): Terminating (SIGINT) 08:13:26.382036 run rm-remote-dir(pid=27239): Terminated: ok {rc=0} 08:13:26.513352 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=27238): Process ended prematurely: srsepc(pid=27238) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27238)] [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 08:13:26.523382 tst iperf3_bidir.py:42: Test FAILED (18.7 sec) 08:13:26.601055 run scp-back-log(pid=27240): Launched 08:13:27.679611 run scp-back-log(pid=27240): ERR: Terminated: ERROR {rc=1} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27240)] 08:13:27.740827 run scp-back-log(pid=27240): stdout: | (launched: 2022-12-14_08:13:26.570037) 08:13:27.803720 run scp-back-log(pid=27240): stderr: | (launched: 2022-12-14_08:13:26.589821) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:13:27.874343 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27240): launch_sync(): local process exited with status 1 [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27240)]') ---------------------------------------------- trial-2401 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 08:13:27.919611 tst iperf3_dl.py:13: Number of physical ue: 1 08:13:28.128671 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:13:28.171532 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 08:13:28.397440 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:13:28.414317 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:13:28.446356 tst iperf3_dl.py: using MSISDN 8590 08:13:28.567771 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8590', subscriber_id=0} 08:13:28.685977 run srsepc_10.42.42.118: Starting srsepc 08:13:29.370791 run rm-remote-dir(pid=27242): Launched 08:13:30.566785 run rm-remote-dir(pid=27242): Terminated: ok {rc=0} 08:13:30.945800 run mk-remote-dir(pid=27243): Launched 08:13:32.145938 run mk-remote-dir(pid=27243): Terminated: ok {rc=0} 08:13:32.463699 run scp-inst-to-remote(pid=27244): Launched 08:13:34.661324 run scp-inst-to-remote(pid=27244): Terminated: ok {rc=0} 08:13:35.027253 run rm-remote-dir(pid=27246): Launched 08:13:36.222630 run rm-remote-dir(pid=27246): Terminated: ok {rc=0} 08:13:36.588033 run mk-remote-dir(pid=27247): Launched 08:13:37.784227 run mk-remote-dir(pid=27247): Terminated: ok {rc=0} 08:13:38.095676 run scp-cfg-to-remote(pid=27248): Launched 08:13:39.288459 run scp-cfg-to-remote(pid=27248): Terminated: ok {rc=0} 08:13:39.598276 run scp-db-to-remote(pid=27250): Launched 08:13:40.791972 run scp-db-to-remote(pid=27250): Terminated: ok {rc=0} 08:13:40.935052 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:13:41.273041 run patchelf(pid=27252): Launched 08:13:42.465601 run patchelf(pid=27252): Terminated: ok {rc=0} 08:13:42.608920 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:13:42.947617 run setcap-netadm(pid=27253): Launched 08:13:44.142357 run setcap-netadm(pid=27253): Terminated: ok {rc=0} 08:13:44.496064 run srsepc(pid=27254): Launched 08:13:44.620685 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:13:45.845875 run rm-remote-dir(pid=27255): Launched 08:13:46.175186 run srsepc(pid=27254): ERR: Terminated: ERROR {rc=127} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27254)] 08:13:46.357119 run srsepc(pid=27254): stdout: | (launched: 2022-12-14_08:13:44.434855) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:13:46.520277 run srsepc(pid=27254): stderr: | (launched: 2022-12-14_08:13:44.484682) | Connection to 10.42.42.116 closed. 08:13:46.670363 run srsepc(pid=27254): stdout: | (launched: 2022-12-14_08:13:44.434855) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:13:46.816719 run srsepc(pid=27254): stderr: | (launched: 2022-12-14_08:13:44.484682) | Connection to 10.42.42.116 closed. 08:13:46.988764 run rm-remote-dir(pid=27255): Terminating (SIGINT) 08:13:47.187811 run rm-remote-dir(pid=27255): Terminated: ok {rc=0} 08:13:47.331907 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=27254): Process ended prematurely: srsepc(pid=27254) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27254)] [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 08:13:47.343131 tst iperf3_dl.py:42: Test FAILED (19.4 sec) 08:13:47.426226 run scp-back-log(pid=27256): Launched 08:13:48.508568 run scp-back-log(pid=27256): ERR: Terminated: ERROR {rc=1} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27256)] 08:13:48.573281 run scp-back-log(pid=27256): stdout: | (launched: 2022-12-14_08:13:47.393797) 08:13:48.639067 run scp-back-log(pid=27256): stderr: | (launched: 2022-12-14_08:13:47.414655) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:13:48.713445 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27256): launch_sync(): local process exited with status 1 [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27256)]') ---------------------------------------------- trial-2401 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 08:13:48.761202 tst iperf3_ul.py:13: Number of physical ue: 1 08:13:48.988577 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:13:49.042057 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 08:13:49.267543 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:13:49.284213 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:13:49.322260 tst iperf3_ul.py: using MSISDN 8591 08:13:49.445350 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8591', subscriber_id=0} 08:13:49.563026 run srsepc_10.42.42.118: Starting srsepc 08:13:50.249208 run rm-remote-dir(pid=27258): Launched 08:13:51.446008 run rm-remote-dir(pid=27258): Terminated: ok {rc=0} 08:13:51.813085 run mk-remote-dir(pid=27259): Launched 08:13:53.008415 run mk-remote-dir(pid=27259): Terminated: ok {rc=0} 08:13:53.320492 run scp-inst-to-remote(pid=27260): Launched 08:13:55.514804 run scp-inst-to-remote(pid=27260): Terminated: ok {rc=0} 08:13:55.880487 run rm-remote-dir(pid=27262): Launched 08:13:57.075994 run rm-remote-dir(pid=27262): Terminated: ok {rc=0} 08:13:57.442965 run mk-remote-dir(pid=27263): Launched 08:13:58.639198 run mk-remote-dir(pid=27263): Terminated: ok {rc=0} 08:13:58.954140 run scp-cfg-to-remote(pid=27264): Launched 08:14:00.146672 run scp-cfg-to-remote(pid=27264): Terminated: ok {rc=0} 08:14:00.438123 run scp-db-to-remote(pid=27266): Launched 08:14:01.641954 run scp-db-to-remote(pid=27266): Terminated: ok {rc=0} 08:14:01.823547 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:14:02.147708 run patchelf(pid=27268): Launched 08:14:03.378179 run patchelf(pid=27268): Terminated: ok {rc=0} 08:14:03.522505 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:14:03.861236 run setcap-netadm(pid=27269): Launched 08:14:05.054512 run setcap-netadm(pid=27269): Terminated: ok {rc=0} 08:14:05.408270 run srsepc(pid=27270): Launched 08:14:05.533604 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:14:06.745928 run rm-remote-dir(pid=27271): Launched 08:14:06.937723 run srsepc(pid=27270): ERR: Terminated: ERROR {rc=127} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27270)] 08:14:07.084067 run srsepc(pid=27270): stdout: | (launched: 2022-12-14_08:14:05.347079) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:14:07.230570 run srsepc(pid=27270): stderr: | (launched: 2022-12-14_08:14:05.396773) | Connection to 10.42.42.116 closed. 08:14:07.377377 run srsepc(pid=27270): stdout: | (launched: 2022-12-14_08:14:05.347079) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:14:07.519228 run srsepc(pid=27270): stderr: | (launched: 2022-12-14_08:14:05.396773) | Connection to 10.42.42.116 closed. 08:14:07.686803 run rm-remote-dir(pid=27271): Terminating (SIGINT) 08:14:07.882390 run rm-remote-dir(pid=27271): Terminated: ok {rc=0} 08:14:08.022798 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=27270): Process ended prematurely: srsepc(pid=27270) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27270)] [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 08:14:08.033666 tst iperf3_ul.py:42: Test FAILED (19.3 sec) 08:14:08.115747 run scp-back-log(pid=27272): Launched 08:14:09.198850 run scp-back-log(pid=27272): ERR: Terminated: ERROR {rc=1} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27272)] 08:14:09.263049 run scp-back-log(pid=27272): stdout: | (launched: 2022-12-14_08:14:08.083448) 08:14:09.328752 run scp-back-log(pid=27272): stderr: | (launched: 2022-12-14_08:14:08.104129) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:14:09.402633 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27272): launch_sync(): local process exited with status 1 [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27272)]') ---------------------------------------------- trial-2401 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 08:14:09.451561 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:14:09.469699 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:14:09.494128 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:14:09.547961 tst ping.py: using MSISDN 8592 08:14:09.673900 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8592', subscriber_id=0} 08:14:09.792267 run srsepc_10.42.42.118: Starting srsepc 08:14:10.479804 run rm-remote-dir(pid=27274): Launched 08:14:11.674672 run rm-remote-dir(pid=27274): Terminated: ok {rc=0} 08:14:12.040863 run mk-remote-dir(pid=27275): Launched 08:14:13.235307 run mk-remote-dir(pid=27275): Terminated: ok {rc=0} 08:14:13.546221 run scp-inst-to-remote(pid=27276): Launched 08:14:15.740108 run scp-inst-to-remote(pid=27276): Terminated: ok {rc=0} 08:14:16.149044 run rm-remote-dir(pid=27278): Launched 08:14:17.367830 run rm-remote-dir(pid=27278): Terminated: ok {rc=0} 08:14:17.734311 run mk-remote-dir(pid=27279): Launched 08:14:18.929309 run mk-remote-dir(pid=27279): Terminated: ok {rc=0} 08:14:19.241174 run scp-cfg-to-remote(pid=27280): Launched 08:14:20.432370 run scp-cfg-to-remote(pid=27280): Terminated: ok {rc=0} 08:14:20.742882 run scp-db-to-remote(pid=27282): Launched 08:14:21.935300 run scp-db-to-remote(pid=27282): Terminated: ok {rc=0} 08:14:22.077857 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:14:22.415799 run patchelf(pid=27284): Launched 08:14:23.607729 run patchelf(pid=27284): Terminated: ok {rc=0} 08:14:23.750974 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:14:24.087329 run setcap-netadm(pid=27285): Launched 08:14:25.279625 run setcap-netadm(pid=27285): Terminated: ok {rc=0} 08:14:25.632696 run srsepc(pid=27286): Launched 08:14:25.758007 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:14:26.963254 run rm-remote-dir(pid=27287): Launched 08:14:27.158520 run srsepc(pid=27286): ERR: Terminated: ERROR {rc=127} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27286)] 08:14:27.304209 run srsepc(pid=27286): stdout: | (launched: 2022-12-14_08:14:25.570853) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:14:27.450768 run srsepc(pid=27286): stderr: | (launched: 2022-12-14_08:14:25.620749) | Connection to 10.42.42.116 closed. 08:14:27.596938 run srsepc(pid=27286): stdout: | (launched: 2022-12-14_08:14:25.570853) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:14:27.738349 run srsepc(pid=27286): stderr: | (launched: 2022-12-14_08:14:25.620749) | Connection to 10.42.42.116 closed. 08:14:27.905723 run rm-remote-dir(pid=27287): Terminating (SIGINT) 08:14:28.100502 run rm-remote-dir(pid=27287): Terminated: ok {rc=0} 08:14:28.240876 tst ping.py:16: ERR: Error: srsepc(pid=27286): Process ended prematurely: srsepc(pid=27286) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27286)] [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 08:14:28.251580 tst ping.py:16: Test FAILED (18.8 sec) 08:14:28.333391 run scp-back-log(pid=27288): Launched 08:14:29.414952 run scp-back-log(pid=27288): ERR: Terminated: ERROR {rc=1} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27288)] 08:14:29.479986 run scp-back-log(pid=27288): stdout: | (launched: 2022-12-14_08:14:28.301147) 08:14:29.545772 run scp-back-log(pid=27288): stderr: | (launched: 2022-12-14_08:14:28.321834) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:14:29.619498 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27288): launch_sync(): local process exited with status 1 [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27288)]') ---------------------------------------------- trial-2401 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 08:14:29.667509 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:14:29.685211 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:14:29.709955 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:14:29.762319 tst rrc_idle_mo_ping.py: using MSISDN 8593 08:14:29.878132 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8593', subscriber_id=0} 08:14:29.987322 run srsepc_10.42.42.118: Starting srsepc 08:14:30.626138 run rm-remote-dir(pid=27290): Launched 08:14:31.827353 run rm-remote-dir(pid=27290): Terminated: ok {rc=0} 08:14:32.227508 run mk-remote-dir(pid=27291): Launched 08:14:33.435578 run mk-remote-dir(pid=27291): Terminated: ok {rc=0} 08:14:33.746107 run scp-inst-to-remote(pid=27292): Launched 08:14:35.938454 run scp-inst-to-remote(pid=27292): Terminated: ok {rc=0} 08:14:36.301184 run rm-remote-dir(pid=27294): Launched 08:14:37.496482 run rm-remote-dir(pid=27294): Terminated: ok {rc=0} 08:14:37.861338 run mk-remote-dir(pid=27295): Launched 08:14:39.056238 run mk-remote-dir(pid=27295): Terminated: ok {rc=0} 08:14:39.367223 run scp-cfg-to-remote(pid=27296): Launched 08:14:40.557678 run scp-cfg-to-remote(pid=27296): Terminated: ok {rc=0} 08:14:40.866907 run scp-db-to-remote(pid=27298): Launched 08:14:42.058882 run scp-db-to-remote(pid=27298): Terminated: ok {rc=0} 08:14:42.201208 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:14:42.536664 run patchelf(pid=27300): Launched 08:14:43.727447 run patchelf(pid=27300): Terminated: ok {rc=0} 08:14:43.870019 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:14:44.206733 run setcap-netadm(pid=27301): Launched 08:14:45.398593 run setcap-netadm(pid=27301): Terminated: ok {rc=0} 08:14:45.750558 run srsepc(pid=27302): Launched 08:14:45.902611 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:14:47.186204 run rm-remote-dir(pid=27303): Launched 08:14:47.432267 run srsepc(pid=27302): ERR: Terminated: ERROR {rc=127} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27302)] 08:14:47.578167 run srsepc(pid=27302): stdout: | (launched: 2022-12-14_08:14:45.688536) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:14:47.724442 run srsepc(pid=27302): stderr: | (launched: 2022-12-14_08:14:45.738610) | Connection to 10.42.42.116 closed. 08:14:47.870585 run srsepc(pid=27302): stdout: | (launched: 2022-12-14_08:14:45.688536) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:14:48.011515 run srsepc(pid=27302): stderr: | (launched: 2022-12-14_08:14:45.738610) | Connection to 10.42.42.116 closed. 08:14:48.178556 run rm-remote-dir(pid=27303): Terminating (SIGINT) 08:14:48.373159 run rm-remote-dir(pid=27303): Terminated: ok {rc=0} 08:14:48.513414 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=27302): Process ended prematurely: srsepc(pid=27302) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27302)] [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 08:14:48.524294 tst rrc_idle_mo_ping.py:16: Test FAILED (18.8 sec) 08:14:48.607018 run scp-back-log(pid=27304): Launched 08:14:49.691084 run scp-back-log(pid=27304): ERR: Terminated: ERROR {rc=1} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27304)] 08:14:49.755795 run scp-back-log(pid=27304): stdout: | (launched: 2022-12-14_08:14:48.574438) 08:14:49.821780 run scp-back-log(pid=27304): stderr: | (launched: 2022-12-14_08:14:48.595386) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:14:49.895851 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27304): launch_sync(): local process exited with status 1 [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27304)]') ---------------------------------------------- trial-2401 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 08:14:49.945684 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:14:49.964148 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:14:49.988245 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:14:50.038957 tst rrc_idle_mt_ping.py: using MSISDN 8594 08:14:50.164596 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8594', subscriber_id=0} 08:14:50.282124 run srsepc_10.42.42.118: Starting srsepc 08:14:50.967975 run rm-remote-dir(pid=27306): Launched 08:14:52.164446 run rm-remote-dir(pid=27306): Terminated: ok {rc=0} 08:14:52.530708 run mk-remote-dir(pid=27307): Launched 08:14:53.726884 run mk-remote-dir(pid=27307): Terminated: ok {rc=0} 08:14:54.039700 run scp-inst-to-remote(pid=27308): Launched 08:14:56.231472 run scp-inst-to-remote(pid=27308): Terminated: ok {rc=0} 08:14:56.573912 run rm-remote-dir(pid=27310): Launched 08:14:57.758203 run rm-remote-dir(pid=27310): Terminated: ok {rc=0} 08:14:58.101525 run mk-remote-dir(pid=27311): Launched 08:14:59.287992 run mk-remote-dir(pid=27311): Terminated: ok {rc=0} 08:14:59.581836 run scp-cfg-to-remote(pid=27313): Launched 08:15:00.764736 run scp-cfg-to-remote(pid=27313): Terminated: ok {rc=0} 08:15:01.128403 run scp-db-to-remote(pid=27315): Launched 08:15:02.391644 run scp-db-to-remote(pid=27315): Terminated: ok {rc=0} 08:15:02.536284 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:15:02.875390 run patchelf(pid=27320): Launched 08:15:04.070840 run patchelf(pid=27320): Terminated: ok {rc=0} 08:15:04.214146 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:15:04.552417 run setcap-netadm(pid=27321): Launched 08:15:05.747965 run setcap-netadm(pid=27321): Terminated: ok {rc=0} 08:15:06.103022 run srsepc(pid=27322): Launched 08:15:06.228320 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:15:07.436769 run rm-remote-dir(pid=27323): Launched 08:15:07.632880 run srsepc(pid=27322): ERR: Terminated: ERROR {rc=127} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27322)] 08:15:07.779963 run srsepc(pid=27322): stdout: | (launched: 2022-12-14_08:15:06.041524) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:15:07.926975 run srsepc(pid=27322): stderr: | (launched: 2022-12-14_08:15:06.091447) | Connection to 10.42.42.116 closed. 08:15:08.074198 run srsepc(pid=27322): stdout: | (launched: 2022-12-14_08:15:06.041524) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:15:08.216084 run srsepc(pid=27322): stderr: | (launched: 2022-12-14_08:15:06.091447) | Connection to 10.42.42.116 closed. 08:15:08.384086 run rm-remote-dir(pid=27323): Terminating (SIGINT) 08:15:08.579459 run rm-remote-dir(pid=27323): Terminated: ok {rc=0} 08:15:08.722907 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=27322): Process ended prematurely: srsepc(pid=27322) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27322)] [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 08:15:08.733679 tst rrc_idle_mt_ping.py:16: Test FAILED (18.8 sec) 08:15:08.816267 run scp-back-log(pid=27325): Launched 08:15:09.896834 run scp-back-log(pid=27325): ERR: Terminated: ERROR {rc=1} [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27325)] 08:15:09.961315 run scp-back-log(pid=27325): stdout: | (launched: 2022-12-14_08:15:08.783698) 08:15:10.027621 run scp-back-log(pid=27325): stderr: | (launched: 2022-12-14_08:15:08.804546) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:15:10.101787 tst srsepc_10.42.42.118: Error('scp-back-log(pid=27325): launch_sync(): local process exited with status 1 [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=27325)]') --------------------------------------------------------------------- trial-2401 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 08:15:10.237965 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:10.243819 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 08:15:10.286861 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 08:15:10.315169 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 08:15:10.368758 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 08:15:10.412695 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 08:15:10.440473 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 08:15:10.989942 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 08:15:10.995708 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:15:11.007166 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 08:15:11.046195 tst handover.py: using LAC 39585 08:15:11.180383 tst handover.py: using RAC 60 08:15:11.311607 tst handover.py: using CellId 39585 08:15:11.443199 tst handover.py: using BVCI 39586 08:15:11.565039 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 08:15:11.600906 tst handover.py: using LAC 39586 08:15:11.730855 tst handover.py: using RAC 61 08:15:11.861503 tst handover.py: using CellId 39586 08:15:11.984606 tst handover.py: using BVCI 39587 08:15:12.098917 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:15:12.110124 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:15:12.120850 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:15:12.131684 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:15:12.142591 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:15:12.153195 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 08:15:12.274882 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 08:15:12.394076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:12.870848 run create_hlr_db(pid=27331): Launched 08:15:14.044555 run create_hlr_db(pid=27331): Terminated: ok {rc=0} 08:15:14.368934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27333): Launched 08:15:14.676501 run osmo-hlr_10.42.42.2(pid=27334): Launched 08:15:14.794464 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:15.326747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27336): Launched 08:15:15.635322 run osmo-stp_10.42.42.5(pid=27337): Launched 08:15:15.752616 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:16.370057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27339): Launched 08:15:16.708368 run osmo-msc_10.42.42.6(pid=27340): Launched 08:15:17.018169 run osmo-stp_10.42.42.5(pid=27337): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27337)] 08:15:17.254821 run osmo-stp_10.42.42.5(pid=27337): stdout: | (launched: 2022-12-14_08:15:15.578680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:17.396695 run osmo-stp_10.42.42.5(pid=27337): stderr: | 20221214081515747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081515747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081515747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081515748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081515748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081515748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081515748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:17.534880 run osmo-stp_10.42.42.5(pid=27337): stdout: | (launched: 2022-12-14_08:15:15.578680) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:17.666085 run osmo-stp_10.42.42.5(pid=27337): stderr: | 20221214081515747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081515747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081515747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081515748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081515748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081515748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081515748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:17.823889 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27337): Process ended prematurely: osmo-stp_10.42.42.5(pid=27337) [trial-2401↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27337)] [trial-2401↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 08:15:17.832920 tst handover.py:18: Test FAILED (6.8 sec) 08:15:17.860777 run osmo-hlr_10.42.42.2(pid=27334): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27334)] 08:15:17.911967 run osmo-hlr_10.42.42.2(pid=27334): stdout: | (launched: 2022-12-14_08:15:14.619770) 08:15:17.964202 run osmo-hlr_10.42.42.2(pid=27334): stderr: | 20221214081514795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081514795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081514795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081514795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081514795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081514795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081514807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081514815 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081514815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081514815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:18.037137 run osmo-msc_10.42.42.6(pid=27340): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27340)] 08:15:18.087713 run osmo-msc_10.42.42.6(pid=27340): stdout: | (launched: 2022-12-14_08:15:16.647803) 08:15:18.140129 run osmo-msc_10.42.42.6(pid=27340): stderr: | 20221214081517176 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081517176 DLGLOBAL DEBUG validating counter group 0x7faac2887c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081517176 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081517176 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081517176 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081517177 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081517178 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081517179 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081517179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081517179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:18.192299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27333): Terminating (SIGTERM) 08:15:18.234743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27336): Terminating (SIGTERM) 08:15:18.277090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27339): Terminating (SIGTERM) 08:15:18.319875 --- ParallelTerminationStrategy: PID 27333 died... 08:15:18.340602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27333): Terminated: ok {rc=0} 08:15:18.387719 --- ParallelTerminationStrategy: PID 27336 died... 08:15:18.407763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27336): Terminated: ok {rc=0} 08:15:18.454141 --- ParallelTerminationStrategy: PID 27339 died... 08:15:18.474010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27339): Terminated: ok {rc=0} 08:15:18.563034 bus /sierra_3: Setting Powered False 08:15:19.662133 bus /sierra_3: Setting Powered False 08:15:20.778292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 08:15:22.025508 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:22.031230 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 08:15:22.072609 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 08:15:22.100446 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 08:15:22.154274 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 08:15:22.195032 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 08:15:22.222828 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 08:15:22.772571 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 08:15:22.778856 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:15:22.790440 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 08:15:22.828108 tst handover.py: using LAC 39587 08:15:22.949158 tst handover.py: using RAC 62 08:15:23.069210 tst handover.py: using CellId 39587 08:15:23.190422 tst handover.py: using BVCI 39588 08:15:23.312581 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 08:15:23.348349 tst handover.py: using LAC 39588 08:15:23.484501 tst handover.py: using RAC 63 08:15:23.615538 tst handover.py: using CellId 39588 08:15:23.745992 tst handover.py: using BVCI 39589 08:15:23.866957 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:15:23.878324 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:15:23.889514 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:15:23.900631 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:15:23.911932 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:15:23.923858 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 08:15:24.043431 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 08:15:24.165649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:24.648850 run create_hlr_db(pid=27345): Launched 08:15:24.775021 bus /sierra_2: Setting Powered False 08:15:25.840679 run create_hlr_db(pid=27345): Terminated: ok {rc=0} 08:15:26.272083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27347): Launched 08:15:26.603851 run osmo-hlr_10.42.42.2(pid=27348): Launched 08:15:26.731008 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:27.270290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27350): Launched 08:15:27.601867 run osmo-stp_10.42.42.5(pid=27351): Launched 08:15:27.731475 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:28.305475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27353): Launched 08:15:28.639467 run osmo-msc_10.42.42.6(pid=27354): Launched 08:15:28.827904 run osmo-stp_10.42.42.5(pid=27351): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27351)] 08:15:28.967959 run osmo-stp_10.42.42.5(pid=27351): stdout: | (launched: 2022-12-14_08:15:27.541884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:29.109200 run osmo-stp_10.42.42.5(pid=27351): stderr: | 20221214081527733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081527733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081527733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081527734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081527734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081527734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081527734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:29.246692 run osmo-stp_10.42.42.5(pid=27351): stdout: | (launched: 2022-12-14_08:15:27.541884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:29.378251 run osmo-stp_10.42.42.5(pid=27351): stderr: | 20221214081527733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081527733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081527733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081527734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081527734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081527734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081527734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:29.535805 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27351): Process ended prematurely: osmo-stp_10.42.42.5(pid=27351) [trial-2401↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27351)] [trial-2401↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 08:15:29.544672 tst handover.py:18: Test FAILED (6.8 sec) 08:15:29.572053 run osmo-hlr_10.42.42.2(pid=27348): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27348)] 08:15:29.622621 run osmo-hlr_10.42.42.2(pid=27348): stdout: | (launched: 2022-12-14_08:15:26.543304) 08:15:29.674506 run osmo-hlr_10.42.42.2(pid=27348): stderr: | 20221214081526740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081526741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081526741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081526741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081526741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081526741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081526753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081526761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081526762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081526762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:29.747753 run osmo-msc_10.42.42.6(pid=27354): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27354)] 08:15:29.797488 run osmo-msc_10.42.42.6(pid=27354): stdout: | (launched: 2022-12-14_08:15:28.578659) 08:15:29.849200 run osmo-msc_10.42.42.6(pid=27354): stderr: | 20221214081528895 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081528895 DLGLOBAL DEBUG validating counter group 0x7f65b97c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081528895 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081528895 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081528896 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081528896 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081528897 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081528898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081528898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081528898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:29.901114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27347): Terminating (SIGTERM) 08:15:29.943614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27350): Terminating (SIGTERM) 08:15:29.985796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27353): Terminating (SIGTERM) 08:15:30.028224 --- ParallelTerminationStrategy: PID 27347 died... 08:15:30.048457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27347): Terminated: ok {rc=0} 08:15:30.095019 --- ParallelTerminationStrategy: PID 27350 died... 08:15:30.114721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27350): Terminated: ok {rc=0} 08:15:30.161489 --- ParallelTerminationStrategy: PID 27353 died... 08:15:30.181306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27353): Terminated: ok {rc=0} 08:15:30.269412 bus /sierra_3: Setting Powered False 08:15:31.369089 bus /sierra_3: Setting Powered False 08:15:32.483140 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 08:15:33.726637 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:33.733858 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 08:15:33.789806 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 08:15:33.817092 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 08:15:33.869938 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 08:15:33.923133 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 08:15:33.949747 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 08:15:34.499186 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 08:15:34.504662 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:34.515878 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:15:34.553339 tst handover.py: using LAC 39589 08:15:34.674833 tst handover.py: using RAC 64 08:15:34.798554 tst handover.py: using CellId 39589 08:15:34.920808 tst handover.py: using BVCI 39590 08:15:35.034838 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:15:35.082293 tst handover.py: using LAC 39590 08:15:35.205387 tst handover.py: using RAC 65 08:15:35.325937 tst handover.py: using CellId 39590 08:15:35.449320 tst handover.py: using BVCI 39591 08:15:35.562526 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:35.573763 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:35.584704 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:35.595792 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:35.607061 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:15:35.618166 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:15:35.740598 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:15:35.863097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:36.346928 run create_hlr_db(pid=27359): Launched 08:15:36.476255 bus /sierra_2: Setting Powered False 08:15:37.541264 run create_hlr_db(pid=27359): Terminated: ok {rc=0} 08:15:37.973547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27361): Launched 08:15:38.307247 run osmo-hlr_10.42.42.2(pid=27362): Launched 08:15:38.434150 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:38.977325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27364): Launched 08:15:39.307654 run osmo-stp_10.42.42.5(pid=27365): Launched 08:15:39.434563 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:40.002660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27367): Launched 08:15:40.335575 run osmo-msc_10.42.42.6(pid=27368): Launched 08:15:40.522038 run osmo-stp_10.42.42.5(pid=27365): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27365)] 08:15:40.661727 run osmo-stp_10.42.42.5(pid=27365): stdout: | (launched: 2022-12-14_08:15:39.247115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:40.802592 run osmo-stp_10.42.42.5(pid=27365): stderr: | 20221214081539437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081539437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081539438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081539438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081539439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081539439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081539439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:40.939919 run osmo-stp_10.42.42.5(pid=27365): stdout: | (launched: 2022-12-14_08:15:39.247115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:41.071206 run osmo-stp_10.42.42.5(pid=27365): stderr: | 20221214081539437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081539437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081539438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081539438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081539439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081539439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081539439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:41.229247 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27365): Process ended prematurely: osmo-stp_10.42.42.5(pid=27365) [trial-2401↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27365)] [trial-2401↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 08:15:41.238045 tst handover.py:18: Test FAILED (6.7 sec) 08:15:41.265421 run osmo-hlr_10.42.42.2(pid=27362): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27362)] 08:15:41.315582 run osmo-hlr_10.42.42.2(pid=27362): stdout: | (launched: 2022-12-14_08:15:38.246128) 08:15:41.367475 run osmo-hlr_10.42.42.2(pid=27362): stderr: | 20221214081538443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081538443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081538443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081538444 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081538444 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081538444 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081538456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081538464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081538464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081538464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:41.439840 run osmo-msc_10.42.42.6(pid=27368): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27368)] 08:15:41.489442 run osmo-msc_10.42.42.6(pid=27368): stdout: | (launched: 2022-12-14_08:15:40.274934) 08:15:41.541167 run osmo-msc_10.42.42.6(pid=27368): stderr: | 20221214081540592 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081540592 DLGLOBAL DEBUG validating counter group 0x7f3d59d57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081540592 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081540592 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081540593 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081540593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081540594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081540595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081540595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081540595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:41.593208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27361): Terminating (SIGTERM) 08:15:41.635214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27364): Terminating (SIGTERM) 08:15:41.677048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27367): Terminating (SIGTERM) 08:15:41.719157 --- ParallelTerminationStrategy: PID 27361 died... 08:15:41.739888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27361): Terminated: ok {rc=0} 08:15:41.787062 --- ParallelTerminationStrategy: PID 27364 died... 08:15:41.806979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27364): Terminated: ok {rc=0} 08:15:41.853305 --- ParallelTerminationStrategy: PID 27367 died... 08:15:41.873131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27367): Terminated: ok {rc=0} 08:15:41.961983 bus /sierra_3: Setting Powered False 08:15:43.059165 bus /sierra_3: Setting Powered False 08:15:44.175012 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:15:45.432157 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:45.438046 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:15:45.488127 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:15:45.514745 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:15:45.571143 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:15:45.620656 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:15:45.647235 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:15:46.247824 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:15:46.255457 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:46.270847 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:15:46.317178 tst handover.py: using LAC 39591 08:15:46.477098 tst handover.py: using RAC 66 08:15:46.612342 tst handover.py: using CellId 39591 08:15:46.764212 tst handover.py: using BVCI 39592 08:15:46.884926 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:15:46.929635 tst handover.py: using LAC 39592 08:15:47.053010 tst handover.py: using RAC 67 08:15:47.208342 tst handover.py: using CellId 39592 08:15:47.327301 tst handover.py: using BVCI 39593 08:15:47.448606 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:47.460515 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:47.472181 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:47.483985 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:47.496066 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:47.508094 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:15:47.626070 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:15:47.747825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:48.230732 run create_hlr_db(pid=27373): Launched 08:15:48.359230 bus /sierra_2: Setting Powered False 08:15:49.424907 run create_hlr_db(pid=27373): Terminated: ok {rc=0} 08:15:49.840441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27375): Launched 08:15:50.149915 run osmo-hlr_10.42.42.2(pid=27376): Launched 08:15:50.267252 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:50.771741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27378): Launched 08:15:51.080575 run osmo-stp_10.42.42.5(pid=27379): Launched 08:15:51.198557 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:51.733946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27381): Launched 08:15:52.059164 run osmo-msc_10.42.42.6(pid=27383): Launched 08:15:52.248507 run osmo-stp_10.42.42.5(pid=27379): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27379)] 08:15:52.389248 run osmo-stp_10.42.42.5(pid=27379): stdout: | (launched: 2022-12-14_08:15:51.023932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:52.529350 run osmo-stp_10.42.42.5(pid=27379): stderr: | 20221214081551196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081551197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081551197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081551197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081551198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081551198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081551198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:52.667118 run osmo-stp_10.42.42.5(pid=27379): stdout: | (launched: 2022-12-14_08:15:51.023932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:52.799042 run osmo-stp_10.42.42.5(pid=27379): stderr: | 20221214081551196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081551197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081551197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081551197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081551198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081551198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081551198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:52.956453 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27379): Process ended prematurely: osmo-stp_10.42.42.5(pid=27379) [trial-2401↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27379)] [trial-2401↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 08:15:52.965356 tst handover.py:18: Test FAILED (6.7 sec) 08:15:52.992721 run osmo-hlr_10.42.42.2(pid=27376): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27376)] 08:15:53.043695 run osmo-hlr_10.42.42.2(pid=27376): stdout: | (launched: 2022-12-14_08:15:50.092460) 08:15:53.095756 run osmo-hlr_10.42.42.2(pid=27376): stderr: | 20221214081550266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081550266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081550266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081550266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081550266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081550266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081550318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081550328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081550328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081550328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:53.167785 run osmo-msc_10.42.42.6(pid=27383): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27383)] 08:15:53.217765 run osmo-msc_10.42.42.6(pid=27383): stdout: | (launched: 2022-12-14_08:15:51.997764) 08:15:53.269856 run osmo-msc_10.42.42.6(pid=27383): stderr: | 20221214081552314 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081552314 DLGLOBAL DEBUG validating counter group 0x7f3824e81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081552314 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081552314 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081552314 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081552315 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081552316 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081552317 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081552317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081552317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:53.322153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27375): Terminating (SIGTERM) 08:15:53.363897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27378): Terminating (SIGTERM) 08:15:53.406402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27381): Terminating (SIGTERM) 08:15:53.448647 --- ParallelTerminationStrategy: PID 27375 died... 08:15:53.468841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27375): Terminated: ok {rc=0} 08:15:53.515361 --- ParallelTerminationStrategy: PID 27378 died... 08:15:53.535235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27378): Terminated: ok {rc=0} 08:15:53.581685 --- ParallelTerminationStrategy: PID 27381 died... 08:15:53.601441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27381): Terminated: ok {rc=0} 08:15:53.689875 bus /sierra_3: Setting Powered False 08:15:54.789126 bus /sierra_3: Setting Powered False 08:15:55.906958 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:15:57.163490 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:57.168719 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:15:57.221880 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:15:57.248226 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:15:57.299781 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:15:57.352921 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:15:57.379111 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:15:57.932311 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:15:57.938065 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:57.949398 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:15:57.987040 tst handover.py: using LAC 39593 08:15:58.109638 tst handover.py: using RAC 68 08:15:58.230660 tst handover.py: using CellId 39593 08:15:58.353997 tst handover.py: using BVCI 39594 08:15:58.467484 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:15:58.516799 tst handover.py: using LAC 39594 08:15:58.640264 tst handover.py: using RAC 69 08:15:58.768096 tst handover.py: using CellId 39594 08:15:58.893556 tst handover.py: using BVCI 39595 08:15:59.006939 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:59.018457 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:59.029634 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:59.040676 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:59.051972 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:59.063270 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:15:59.184090 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:15:59.301374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:59.753433 run create_hlr_db(pid=27388): Launched 08:15:59.881575 bus /sierra_2: Setting Powered False 08:16:00.949318 run create_hlr_db(pid=27388): Terminated: ok {rc=0} 08:16:01.445775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27390): Launched 08:16:01.797796 run osmo-hlr_10.42.42.2(pid=27391): Launched 08:16:01.999215 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:02.725698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27393): Launched 08:16:03.037685 run osmo-stp_10.42.42.5(pid=27394): Launched 08:16:03.156235 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:03.691457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27396): Launched 08:16:04.001482 run osmo-msc_10.42.42.6(pid=27397): Launched 08:16:04.175200 run osmo-stp_10.42.42.5(pid=27394): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27394)] 08:16:04.305262 run osmo-stp_10.42.42.5(pid=27394): stdout: | (launched: 2022-12-14_08:16:02.980520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:04.436058 run osmo-stp_10.42.42.5(pid=27394): stderr: | 20221214081603153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081603153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081603153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081603154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081603154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081603154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081603154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:04.564868 run osmo-stp_10.42.42.5(pid=27394): stdout: | (launched: 2022-12-14_08:16:02.980520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:04.687974 run osmo-stp_10.42.42.5(pid=27394): stderr: | 20221214081603153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081603153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081603153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081603154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081603154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081603154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081603154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:04.835691 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27394): Process ended prematurely: osmo-stp_10.42.42.5(pid=27394) [trial-2401↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27394)] [trial-2401↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 08:16:04.844074 tst handover.py:18: Test FAILED (6.9 sec) 08:16:04.870157 run osmo-hlr_10.42.42.2(pid=27391): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27391)] 08:16:04.917910 run osmo-hlr_10.42.42.2(pid=27391): stdout: | (launched: 2022-12-14_08:16:01.729643) 08:16:04.967390 run osmo-hlr_10.42.42.2(pid=27391): stderr: | 20221214081602045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081602045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081602045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081602045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081602045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081602045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081602063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081602082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081602082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081602082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:05.035901 run osmo-msc_10.42.42.6(pid=27397): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27397)] 08:16:05.083208 run osmo-msc_10.42.42.6(pid=27397): stdout: | (launched: 2022-12-14_08:16:03.944523) 08:16:05.132267 run osmo-msc_10.42.42.6(pid=27397): stderr: | 20221214081604215 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081604215 DLGLOBAL DEBUG validating counter group 0x7f62c7446c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081604215 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081604215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081604215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081604216 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081604217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081604218 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081604218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081604218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:05.181731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27390): Terminating (SIGTERM) 08:16:05.221615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27393): Terminating (SIGTERM) 08:16:05.261227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27396): Terminating (SIGTERM) 08:16:05.301650 --- ParallelTerminationStrategy: PID 27390 died... 08:16:05.320653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27390): Terminated: ok {rc=0} 08:16:05.364212 --- ParallelTerminationStrategy: PID 27393 died... 08:16:05.382573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27393): Terminated: ok {rc=0} 08:16:05.425954 --- ParallelTerminationStrategy: PID 27396 died... 08:16:05.444312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27396): Terminated: ok {rc=0} 08:16:05.530062 bus /sierra_3: Setting Powered False 08:16:06.628081 bus /sierra_3: Setting Powered False 08:16:07.744441 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 08:16:09.005429 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:09.010628 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:16:09.051437 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:16:09.078394 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:16:09.131650 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:16:09.173811 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:16:09.200053 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:16:09.746766 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 08:16:09.752227 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:09.763360 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 08:16:09.801450 tst handover.py: using LAC 39595 08:16:09.923153 tst handover.py: using RAC 70 08:16:10.051487 tst handover.py: using CellId 39595 08:16:10.173476 tst handover.py: using BVCI 39596 08:16:10.287720 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 08:16:10.321372 tst handover.py: using LAC 39596 08:16:10.440751 tst handover.py: using RAC 71 08:16:10.560792 tst handover.py: using CellId 39596 08:16:10.690326 tst handover.py: using BVCI 39597 08:16:10.811447 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.823086 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.834290 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.845802 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.857376 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.868781 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 08:16:10.989190 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 08:16:11.111903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:11.594959 run create_hlr_db(pid=27402): Launched 08:16:11.720913 bus /sierra_2: Setting Powered False 08:16:12.785939 run create_hlr_db(pid=27402): Terminated: ok {rc=0} 08:16:13.201080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27404): Launched 08:16:13.509391 run osmo-hlr_10.42.42.2(pid=27405): Launched 08:16:13.629362 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:14.138349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27407): Launched 08:16:14.446840 run osmo-stp_10.42.42.5(pid=27408): Launched 08:16:14.565299 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:15.096021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27410): Launched 08:16:15.406152 run osmo-msc_10.42.42.6(pid=27411): Launched 08:16:15.581482 run osmo-stp_10.42.42.5(pid=27408): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27408)] 08:16:15.710709 run osmo-stp_10.42.42.5(pid=27408): stdout: | (launched: 2022-12-14_08:16:14.390274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:15.851815 run osmo-stp_10.42.42.5(pid=27408): stderr: | 20221214081614559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081614559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081614560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081614560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081614561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081614561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081614561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:16.000714 run osmo-stp_10.42.42.5(pid=27408): stdout: | (launched: 2022-12-14_08:16:14.390274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:16.139041 run osmo-stp_10.42.42.5(pid=27408): stderr: | 20221214081614559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081614559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081614560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081614560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081614561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081614561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081614561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:16.301135 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27408): Process ended prematurely: osmo-stp_10.42.42.5(pid=27408) [trial-2401↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27408)] [trial-2401↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 08:16:16.311201 tst handover.py:18: Test FAILED (6.6 sec) 08:16:16.344044 run osmo-hlr_10.42.42.2(pid=27405): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27405)] 08:16:16.402100 run osmo-hlr_10.42.42.2(pid=27405): stdout: | (launched: 2022-12-14_08:16:13.452127) 08:16:16.462445 run osmo-hlr_10.42.42.2(pid=27405): stderr: | 20221214081613627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081613627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081613627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081613627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081613627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081613627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081613644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081613653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081613654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081613654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:16.545912 run osmo-msc_10.42.42.6(pid=27411): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27411)] 08:16:16.598630 run osmo-msc_10.42.42.6(pid=27411): stdout: | (launched: 2022-12-14_08:16:15.348789) 08:16:16.653552 run osmo-msc_10.42.42.6(pid=27411): stderr: | 20221214081615616 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081615617 DLGLOBAL DEBUG validating counter group 0x7f1507991c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081615617 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081615617 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081615617 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081615617 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081615619 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081615619 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081615619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081615619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:16.707367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27404): Terminating (SIGTERM) 08:16:16.753359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27407): Terminating (SIGTERM) 08:16:16.799926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27410): Terminating (SIGTERM) 08:16:16.846773 --- ParallelTerminationStrategy: PID 27404 died... 08:16:16.869505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27404): Terminated: ok {rc=0} 08:16:16.920699 --- ParallelTerminationStrategy: PID 27407 died... 08:16:16.942358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27407): Terminated: ok {rc=0} 08:16:16.991488 --- ParallelTerminationStrategy: PID 27410 died... 08:16:17.013726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27410): Terminated: ok {rc=0} 08:16:17.106451 bus /sierra_3: Setting Powered False 08:16:18.208293 bus /sierra_3: Setting Powered False 08:16:19.323506 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 08:16:20.571411 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:20.576715 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:16:20.630091 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:16:20.656612 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:16:20.710687 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:16:20.763657 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:16:20.789845 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:16:21.343076 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 08:16:21.349859 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:21.361827 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:16:21.400922 tst handover.py: using LAC 39597 08:16:21.530469 tst handover.py: using RAC 72 08:16:21.666715 tst handover.py: using CellId 39597 08:16:21.796099 tst handover.py: using BVCI 39598 08:16:21.916738 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:16:21.965506 tst handover.py: using LAC 39598 08:16:22.086851 tst handover.py: using RAC 73 08:16:22.216681 tst handover.py: using CellId 39598 08:16:22.344634 tst handover.py: using BVCI 39599 08:16:22.465462 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:22.477010 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:22.488479 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:22.499855 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:22.511805 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:22.523433 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:16:22.643302 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:16:22.764203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:23.216008 run create_hlr_db(pid=27416): Launched 08:16:23.344099 bus /sierra_2: Setting Powered False 08:16:24.405762 run create_hlr_db(pid=27416): Terminated: ok {rc=0} 08:16:24.809162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27418): Launched 08:16:25.119655 run osmo-hlr_10.42.42.2(pid=27419): Launched 08:16:25.237666 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:25.755872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27421): Launched 08:16:26.063400 run osmo-stp_10.42.42.5(pid=27422): Launched 08:16:26.181819 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:26.712029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27424): Launched 08:16:27.020201 run osmo-msc_10.42.42.6(pid=27425): Launched 08:16:27.192385 run osmo-stp_10.42.42.5(pid=27422): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27422)] 08:16:27.322017 run osmo-stp_10.42.42.5(pid=27422): stdout: | (launched: 2022-12-14_08:16:26.006940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:27.450645 run osmo-stp_10.42.42.5(pid=27422): stderr: | 20221214081626177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081626177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081626177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081626177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081626178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081626178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081626178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:27.578264 run osmo-stp_10.42.42.5(pid=27422): stdout: | (launched: 2022-12-14_08:16:26.006940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:27.700096 run osmo-stp_10.42.42.5(pid=27422): stderr: | 20221214081626177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081626177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081626177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081626177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081626178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081626178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081626178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:27.846615 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27422): Process ended prematurely: osmo-stp_10.42.42.5(pid=27422) [trial-2401↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27422)] [trial-2401↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 08:16:27.854837 tst handover.py:18: Test FAILED (6.5 sec) 08:16:27.880607 run osmo-hlr_10.42.42.2(pid=27419): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27419)] 08:16:27.927675 run osmo-hlr_10.42.42.2(pid=27419): stdout: | (launched: 2022-12-14_08:16:25.062970) 08:16:27.976432 run osmo-hlr_10.42.42.2(pid=27419): stderr: | 20221214081625239 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081625239 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081625239 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081625239 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081625239 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081625239 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081625251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081625259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081625259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081625260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:28.044574 run osmo-msc_10.42.42.6(pid=27425): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27425)] 08:16:28.092136 run osmo-msc_10.42.42.6(pid=27425): stdout: | (launched: 2022-12-14_08:16:26.963516) 08:16:28.140864 run osmo-msc_10.42.42.6(pid=27425): stderr: | 20221214081627232 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081627232 DLGLOBAL DEBUG validating counter group 0x7fbe4afcfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081627232 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081627232 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081627232 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081627232 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081627234 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081627234 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081627235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081627235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:28.190030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27418): Terminating (SIGTERM) 08:16:28.229485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27421): Terminating (SIGTERM) 08:16:28.268851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27424): Terminating (SIGTERM) 08:16:28.308517 --- ParallelTerminationStrategy: PID 27418 died... 08:16:28.327555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27418): Terminated: ok {rc=0} 08:16:28.371274 --- ParallelTerminationStrategy: PID 27421 died... 08:16:28.389786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27421): Terminated: ok {rc=0} 08:16:28.433202 --- ParallelTerminationStrategy: PID 27424 died... 08:16:28.451804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27424): Terminated: ok {rc=0} 08:16:28.534936 bus /sierra_3: Setting Powered False 08:16:29.630808 bus /sierra_3: Setting Powered False 08:16:30.746445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 08:16:32.036091 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:32.044858 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:16:32.113885 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:16:32.147176 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:16:32.204385 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:16:32.258492 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:16:32.285329 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:16:32.841091 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 08:16:32.846753 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:32.858327 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:16:32.898392 tst handover.py: using LAC 39599 08:16:33.020591 tst handover.py: using RAC 74 08:16:33.143846 tst handover.py: using CellId 39599 08:16:33.266672 tst handover.py: using BVCI 39600 08:16:33.380718 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:16:33.429455 tst handover.py: using LAC 39600 08:16:33.558991 tst handover.py: using RAC 75 08:16:33.689997 tst handover.py: using CellId 39600 08:16:33.819505 tst handover.py: using BVCI 39601 08:16:33.939904 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.951678 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.963157 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.974654 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.986609 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.998800 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:16:34.122018 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:16:34.239810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:34.692400 run create_hlr_db(pid=27430): Launched 08:16:34.818655 bus /sierra_2: Setting Powered False 08:16:35.879638 run create_hlr_db(pid=27430): Terminated: ok {rc=0} 08:16:36.303207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27432): Launched 08:16:36.636380 run osmo-hlr_10.42.42.2(pid=27433): Launched 08:16:36.763432 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:37.301647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27435): Launched 08:16:37.634022 run osmo-stp_10.42.42.5(pid=27436): Launched 08:16:37.760166 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:38.328179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27438): Launched 08:16:38.659858 run osmo-msc_10.42.42.6(pid=27439): Launched 08:16:38.847013 run osmo-stp_10.42.42.5(pid=27436): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27436)] 08:16:38.986330 run osmo-stp_10.42.42.5(pid=27436): stdout: | (launched: 2022-12-14_08:16:37.573085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:39.126222 run osmo-stp_10.42.42.5(pid=27436): stderr: | 20221214081637766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081637766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081637766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081637767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081637767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081637767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081637767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:39.263624 run osmo-stp_10.42.42.5(pid=27436): stdout: | (launched: 2022-12-14_08:16:37.573085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:39.395339 run osmo-stp_10.42.42.5(pid=27436): stderr: | 20221214081637766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081637766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081637766 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081637767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081637767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081637767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081637767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:39.552759 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27436): Process ended prematurely: osmo-stp_10.42.42.5(pid=27436) [trial-2401↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27436)] [trial-2401↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 08:16:39.561682 tst handover.py:18: Test FAILED (6.7 sec) 08:16:39.589074 run osmo-hlr_10.42.42.2(pid=27433): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27433)] 08:16:39.639743 run osmo-hlr_10.42.42.2(pid=27433): stdout: | (launched: 2022-12-14_08:16:36.575378) 08:16:39.691837 run osmo-hlr_10.42.42.2(pid=27433): stderr: | 20221214081636775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081636775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081636775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081636775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081636775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081636775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081636787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081636797 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081636798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081636798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:39.764588 run osmo-msc_10.42.42.6(pid=27439): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27439)] 08:16:39.814648 run osmo-msc_10.42.42.6(pid=27439): stdout: | (launched: 2022-12-14_08:16:38.599538) 08:16:39.866425 run osmo-msc_10.42.42.6(pid=27439): stderr: | 20221214081638919 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081638919 DLGLOBAL DEBUG validating counter group 0x7f1782bc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081638919 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081638919 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081638920 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081638920 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081638921 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081638922 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081638922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081638922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:39.918379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27432): Terminating (SIGTERM) 08:16:39.960510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27435): Terminating (SIGTERM) 08:16:40.002736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27438): Terminating (SIGTERM) 08:16:40.045462 --- ParallelTerminationStrategy: PID 27432 died... 08:16:40.065869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27432): Terminated: ok {rc=0} 08:16:40.112282 --- ParallelTerminationStrategy: PID 27435 died... 08:16:40.132118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27435): Terminated: ok {rc=0} 08:16:40.178499 --- ParallelTerminationStrategy: PID 27438 died... 08:16:40.198508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27438): Terminated: ok {rc=0} 08:16:40.286473 bus /sierra_3: Setting Powered False 08:16:41.385117 bus /sierra_3: Setting Powered False 08:16:42.500288 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 08:16:43.760426 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:43.765671 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 08:16:43.801606 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 08:16:43.828407 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 08:16:43.881150 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 08:16:43.918640 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 08:16:43.946368 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 08:16:44.492339 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 08:16:44.497861 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:16:44.509064 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 08:16:44.542835 tst handover.py: using LAC 39601 08:16:44.664887 tst handover.py: using RAC 76 08:16:44.788569 tst handover.py: using CellId 39601 08:16:44.915439 tst handover.py: using BVCI 39602 08:16:45.029445 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 08:16:45.062493 tst handover.py: using LAC 39602 08:16:45.191880 tst handover.py: using RAC 77 08:16:45.319587 tst handover.py: using CellId 39602 08:16:45.449394 tst handover.py: using BVCI 39603 08:16:45.569438 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:16:45.580892 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:16:45.592202 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:16:45.603413 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:16:45.614970 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:16:45.626657 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 08:16:45.746549 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 08:16:45.878067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:46.354693 run create_hlr_db(pid=27445): Launched 08:16:46.518391 bus /sierra_2: Setting Powered False 08:16:47.580415 run create_hlr_db(pid=27445): Terminated: ok {rc=0} 08:16:47.987082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27447): Launched 08:16:48.298282 run osmo-hlr_10.42.42.2(pid=27448): Launched 08:16:48.415532 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:48.917347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27450): Launched 08:16:49.226765 run osmo-stp_10.42.42.5(pid=27451): Launched 08:16:49.344366 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:49.875432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27453): Launched 08:16:50.185148 run osmo-msc_10.42.42.6(pid=27454): Launched 08:16:50.359318 run osmo-stp_10.42.42.5(pid=27451): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27451)] 08:16:50.488533 run osmo-stp_10.42.42.5(pid=27451): stdout: | (launched: 2022-12-14_08:16:49.170016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:50.617851 run osmo-stp_10.42.42.5(pid=27451): stderr: | 20221214081649339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081649339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081649339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081649340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081649340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081649340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081649341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:50.745964 run osmo-stp_10.42.42.5(pid=27451): stdout: | (launched: 2022-12-14_08:16:49.170016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:50.868215 run osmo-stp_10.42.42.5(pid=27451): stderr: | 20221214081649339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081649339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081649339 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081649340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081649340 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081649340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081649341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:51.015168 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27451): Process ended prematurely: osmo-stp_10.42.42.5(pid=27451) [trial-2401↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27451)] [trial-2401↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 08:16:51.023692 tst handover.py:18: Test FAILED (6.5 sec) 08:16:51.049817 run osmo-hlr_10.42.42.2(pid=27448): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27448)] 08:16:51.097487 run osmo-hlr_10.42.42.2(pid=27448): stdout: | (launched: 2022-12-14_08:16:48.241149) 08:16:51.146844 run osmo-hlr_10.42.42.2(pid=27448): stderr: | 20221214081648416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081648416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081648416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081648416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081648417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081648417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081648429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081648437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081648437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081648437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:51.215815 run osmo-msc_10.42.42.6(pid=27454): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27454)] 08:16:51.263031 run osmo-msc_10.42.42.6(pid=27454): stdout: | (launched: 2022-12-14_08:16:50.128174) 08:16:51.311821 run osmo-msc_10.42.42.6(pid=27454): stderr: | 20221214081650397 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081650397 DLGLOBAL DEBUG validating counter group 0x7fc4f5962c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081650397 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081650397 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081650397 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081650398 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081650400 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081650400 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081650400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081650400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:51.361390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27447): Terminating (SIGTERM) 08:16:51.400894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27450): Terminating (SIGTERM) 08:16:51.440345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27453): Terminating (SIGTERM) 08:16:51.480155 --- ParallelTerminationStrategy: PID 27447 died... 08:16:51.499509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27447): Terminated: ok {rc=0} 08:16:51.543271 --- ParallelTerminationStrategy: PID 27450 died... 08:16:51.562026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27450): Terminated: ok {rc=0} 08:16:51.605615 --- ParallelTerminationStrategy: PID 27453 died... 08:16:51.624308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27453): Terminated: ok {rc=0} 08:16:51.707628 bus /sierra_3: Setting Powered False 08:16:52.803502 bus /sierra_3: Setting Powered False 08:16:53.918371 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 08:16:55.160410 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:55.166364 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 08:16:55.218471 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 08:16:55.245810 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 08:16:55.299395 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 08:16:55.352631 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 08:16:55.379935 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 08:16:55.929555 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 08:16:55.935804 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:16:55.948464 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:16:55.987090 tst handover.py: using LAC 39603 08:16:56.119035 tst handover.py: using RAC 78 08:16:56.249473 tst handover.py: using CellId 39603 08:16:56.373735 tst handover.py: using BVCI 39604 08:16:56.487174 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:16:56.535545 tst handover.py: using LAC 39604 08:16:56.659112 tst handover.py: using RAC 79 08:16:56.782008 tst handover.py: using CellId 39604 08:16:56.905591 tst handover.py: using BVCI 39605 08:16:57.018203 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:16:57.029314 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:16:57.040070 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:16:57.050745 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:16:57.061454 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:16:57.073381 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:16:57.194922 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:16:57.312688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:57.763656 run create_hlr_db(pid=27459): Launched 08:16:57.890680 bus /sierra_2: Setting Powered False 08:16:58.951302 run create_hlr_db(pid=27459): Terminated: ok {rc=0} 08:16:59.373713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27461): Launched 08:16:59.708075 run osmo-hlr_10.42.42.2(pid=27462): Launched 08:16:59.835064 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:00.377266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27464): Launched 08:17:00.709127 run osmo-stp_10.42.42.5(pid=27465): Launched 08:17:00.856286 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:01.505182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27470): Launched 08:17:01.836686 run osmo-msc_10.42.42.6(pid=27471): Launched 08:17:02.071407 run osmo-stp_10.42.42.5(pid=27465): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27465)] 08:17:02.277420 run osmo-stp_10.42.42.5(pid=27465): stdout: | (launched: 2022-12-14_08:17:00.649075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:02.494522 run osmo-stp_10.42.42.5(pid=27465): stderr: | 20221214081700842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081700842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081700843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081700843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081700843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081700843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081700844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:02.623272 run osmo-stp_10.42.42.5(pid=27465): stdout: | (launched: 2022-12-14_08:17:00.649075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:02.745265 run osmo-stp_10.42.42.5(pid=27465): stderr: | 20221214081700842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081700842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081700843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081700843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081700843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081700843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081700844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:02.892024 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27465): Process ended prematurely: osmo-stp_10.42.42.5(pid=27465) [trial-2401↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27465)] [trial-2401↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 08:17:02.900560 tst handover.py:18: Test FAILED (7.0 sec) 08:17:02.926878 run osmo-hlr_10.42.42.2(pid=27462): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27462)] 08:17:02.974910 run osmo-hlr_10.42.42.2(pid=27462): stdout: | (launched: 2022-12-14_08:16:59.647478) 08:17:03.024576 run osmo-hlr_10.42.42.2(pid=27462): stderr: | 20221214081659844 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081659844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081659844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081659844 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081659844 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081659845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081659857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081659868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081659869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081659869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:03.094222 run osmo-msc_10.42.42.6(pid=27471): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27471)] 08:17:03.141929 run osmo-msc_10.42.42.6(pid=27471): stdout: | (launched: 2022-12-14_08:17:01.778550) 08:17:03.191356 run osmo-msc_10.42.42.6(pid=27471): stderr: | 20221214081702320 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081702320 DLGLOBAL DEBUG validating counter group 0x7f51b8814c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081702320 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081702320 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081702321 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081702321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081702322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081702323 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081702323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081702323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:03.241348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27461): Terminating (SIGTERM) 08:17:03.281615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27464): Terminating (SIGTERM) 08:17:03.321647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27470): Terminating (SIGTERM) 08:17:03.362244 --- ParallelTerminationStrategy: PID 27461 died... 08:17:03.381450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27461): Terminated: ok {rc=0} 08:17:03.425620 --- ParallelTerminationStrategy: PID 27464 died... 08:17:03.444327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27464): Terminated: ok {rc=0} 08:17:03.488118 --- ParallelTerminationStrategy: PID 27470 died... 08:17:03.506940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27470): Terminated: ok {rc=0} 08:17:03.592401 bus /sierra_3: Setting Powered False 08:17:04.691539 bus /sierra_3: Setting Powered False 08:17:05.806782 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:17:07.068694 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:07.074823 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:17:07.123860 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:17:07.151604 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:17:07.206470 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:17:07.254472 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:17:07.281927 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:17:07.833338 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:17:07.839201 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:07.851150 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:17:07.887200 tst handover.py: using LAC 39605 08:17:08.010997 tst handover.py: using RAC 80 08:17:08.134176 tst handover.py: using CellId 39605 08:17:08.261823 tst handover.py: using BVCI 39606 08:17:08.375083 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:17:08.419756 tst handover.py: using LAC 39606 08:17:08.539630 tst handover.py: using RAC 81 08:17:08.659772 tst handover.py: using CellId 39606 08:17:08.781379 tst handover.py: using BVCI 39607 08:17:08.895887 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:08.907055 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:08.918089 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:08.929074 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:08.940020 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:17:08.951003 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:17:09.073601 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:17:09.192440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:09.645429 run create_hlr_db(pid=27476): Launched 08:17:09.772265 bus /sierra_2: Setting Powered False 08:17:10.834603 run create_hlr_db(pid=27476): Terminated: ok {rc=0} 08:17:11.258382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27478): Launched 08:17:11.591029 run osmo-hlr_10.42.42.2(pid=27479): Launched 08:17:11.719402 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:12.266122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27481): Launched 08:17:12.598623 run osmo-stp_10.42.42.5(pid=27482): Launched 08:17:12.726664 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:13.296260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27484): Launched 08:17:13.628840 run osmo-msc_10.42.42.6(pid=27485): Launched 08:17:13.816195 run osmo-stp_10.42.42.5(pid=27482): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27482)] 08:17:13.955131 run osmo-stp_10.42.42.5(pid=27482): stdout: | (launched: 2022-12-14_08:17:12.538218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:14.094966 run osmo-stp_10.42.42.5(pid=27482): stderr: | 20221214081712728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081712728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081712729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081712729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081712730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081712730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081712730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:14.232451 run osmo-stp_10.42.42.5(pid=27482): stdout: | (launched: 2022-12-14_08:17:12.538218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:14.364207 run osmo-stp_10.42.42.5(pid=27482): stderr: | 20221214081712728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081712728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081712729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081712729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081712730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081712730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081712730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:14.521976 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27482): Process ended prematurely: osmo-stp_10.42.42.5(pid=27482) [trial-2401↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27482)] [trial-2401↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 08:17:14.531025 tst handover.py:18: Test FAILED (6.7 sec) 08:17:14.558891 run osmo-hlr_10.42.42.2(pid=27479): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27479)] 08:17:14.609687 run osmo-hlr_10.42.42.2(pid=27479): stdout: | (launched: 2022-12-14_08:17:11.530826) 08:17:14.661679 run osmo-hlr_10.42.42.2(pid=27479): stderr: | 20221214081711727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081711727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081711727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081711727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081711727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081711727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081711739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081711748 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081711748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081711749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:14.734137 run osmo-msc_10.42.42.6(pid=27485): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27485)] 08:17:14.784300 run osmo-msc_10.42.42.6(pid=27485): stdout: | (launched: 2022-12-14_08:17:13.568256) 08:17:14.837355 run osmo-msc_10.42.42.6(pid=27485): stderr: | 20221214081713887 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081713887 DLGLOBAL DEBUG validating counter group 0x7f8220451c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081713887 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081713887 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081713887 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081713887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081713889 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081713890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081713890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081713890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:14.890618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27478): Terminating (SIGTERM) 08:17:14.933114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27481): Terminating (SIGTERM) 08:17:14.975213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27484): Terminating (SIGTERM) 08:17:15.017653 --- ParallelTerminationStrategy: PID 27478 died... 08:17:15.038146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27478): Terminated: ok {rc=0} 08:17:15.084874 --- ParallelTerminationStrategy: PID 27481 died... 08:17:15.105013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27481): Terminated: ok {rc=0} 08:17:15.151677 --- ParallelTerminationStrategy: PID 27484 died... 08:17:15.171686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27484): Terminated: ok {rc=0} 08:17:15.260547 bus /sierra_3: Setting Powered False 08:17:16.357600 bus /sierra_3: Setting Powered False 08:17:17.475066 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:17:18.728333 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:18.734193 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:17:18.785631 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:17:18.812255 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:17:18.865234 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:17:18.918292 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:17:18.945482 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:17:19.492051 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:17:19.498309 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:19.510056 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:17:19.548398 tst handover.py: using LAC 39607 08:17:19.669333 tst handover.py: using RAC 82 08:17:19.789022 tst handover.py: using CellId 39607 08:17:19.908226 tst handover.py: using BVCI 39608 08:17:20.019977 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:17:20.067004 tst handover.py: using LAC 39608 08:17:20.186250 tst handover.py: using RAC 83 08:17:20.307478 tst handover.py: using CellId 39608 08:17:20.428060 tst handover.py: using BVCI 39609 08:17:20.540918 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:20.551935 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:20.562833 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:20.573651 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:20.584463 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:17:20.595321 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:17:20.716778 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:17:20.835154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:21.287091 run create_hlr_db(pid=27490): Launched 08:17:21.414983 bus /sierra_2: Setting Powered False 08:17:22.475533 run create_hlr_db(pid=27490): Terminated: ok {rc=0} 08:17:22.898456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27492): Launched 08:17:23.231140 run osmo-hlr_10.42.42.2(pid=27493): Launched 08:17:23.359184 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:23.901065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27495): Launched 08:17:24.231991 run osmo-stp_10.42.42.5(pid=27496): Launched 08:17:24.358890 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:24.929493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27498): Launched 08:17:25.263625 run osmo-msc_10.42.42.6(pid=27499): Launched 08:17:25.450941 run osmo-stp_10.42.42.5(pid=27496): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27496)] 08:17:25.590033 run osmo-stp_10.42.42.5(pid=27496): stdout: | (launched: 2022-12-14_08:17:24.171513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:25.728302 run osmo-stp_10.42.42.5(pid=27496): stderr: | 20221214081724362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081724363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081724363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081724363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081724364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081724364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081724364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:25.867307 run osmo-stp_10.42.42.5(pid=27496): stdout: | (launched: 2022-12-14_08:17:24.171513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:25.998951 run osmo-stp_10.42.42.5(pid=27496): stderr: | 20221214081724362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081724363 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081724363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081724363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081724364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081724364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081724364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:26.156920 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27496): Process ended prematurely: osmo-stp_10.42.42.5(pid=27496) [trial-2401↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27496)] [trial-2401↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 08:17:26.166081 tst handover.py:18: Test FAILED (6.7 sec) 08:17:26.193606 run osmo-hlr_10.42.42.2(pid=27493): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27493)] 08:17:26.244199 run osmo-hlr_10.42.42.2(pid=27493): stdout: | (launched: 2022-12-14_08:17:23.170857) 08:17:26.296032 run osmo-hlr_10.42.42.2(pid=27493): stderr: | 20221214081723368 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081723368 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081723368 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081723368 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081723368 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081723368 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081723380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081723389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081723389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081723389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:26.368470 run osmo-msc_10.42.42.6(pid=27499): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27499)] 08:17:26.418060 run osmo-msc_10.42.42.6(pid=27499): stdout: | (launched: 2022-12-14_08:17:25.202909) 08:17:26.469555 run osmo-msc_10.42.42.6(pid=27499): stderr: | 20221214081725519 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081725520 DLGLOBAL DEBUG validating counter group 0x7fc476fbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081725520 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081725520 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081725520 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081725520 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081725523 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081725523 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081725523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081725523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:26.521565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27492): Terminating (SIGTERM) 08:17:26.563803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27495): Terminating (SIGTERM) 08:17:26.605858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27498): Terminating (SIGTERM) 08:17:26.648184 --- ParallelTerminationStrategy: PID 27492 died... 08:17:26.668722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27492): Terminated: ok {rc=0} 08:17:26.715386 --- ParallelTerminationStrategy: PID 27495 died... 08:17:26.735380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27495): Terminated: ok {rc=0} 08:17:26.781580 --- ParallelTerminationStrategy: PID 27498 died... 08:17:26.801819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27498): Terminated: ok {rc=0} 08:17:26.890032 bus /sierra_3: Setting Powered False 08:17:27.989254 bus /sierra_3: Setting Powered False 08:17:29.107069 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 08:17:30.365134 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:30.370616 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:17:30.408480 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:17:30.435154 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:17:30.487715 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:17:30.526373 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:17:30.552888 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:17:31.105219 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 08:17:31.111278 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:31.123228 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 08:17:31.158030 tst handover.py: using LAC 39609 08:17:31.288058 tst handover.py: using RAC 84 08:17:31.412208 tst handover.py: using CellId 39609 08:17:31.545030 tst handover.py: using BVCI 39610 08:17:31.669061 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 08:17:31.705678 tst handover.py: using LAC 39610 08:17:31.844536 tst handover.py: using RAC 85 08:17:31.967597 tst handover.py: using CellId 39610 08:17:32.116482 tst handover.py: using BVCI 39611 08:17:32.245232 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:32.257629 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:32.269831 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:32.282308 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:32.295732 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:17:32.309027 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 08:17:32.429339 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 08:17:32.545645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:32.998908 run create_hlr_db(pid=27505): Launched 08:17:33.127073 bus /sierra_2: Setting Powered False 08:17:34.188562 run create_hlr_db(pid=27505): Terminated: ok {rc=0} 08:17:34.593439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27507): Launched 08:17:34.906187 run osmo-hlr_10.42.42.2(pid=27508): Launched 08:17:35.024652 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:35.546019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27510): Launched 08:17:35.856290 run osmo-stp_10.42.42.5(pid=27511): Launched 08:17:35.974382 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:36.507426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27513): Launched 08:17:36.818173 run osmo-msc_10.42.42.6(pid=27514): Launched 08:17:36.993291 run osmo-stp_10.42.42.5(pid=27511): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27511)] 08:17:37.123110 run osmo-stp_10.42.42.5(pid=27511): stdout: | (launched: 2022-12-14_08:17:35.798743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:37.252065 run osmo-stp_10.42.42.5(pid=27511): stderr: | 20221214081735971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081735971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081735971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081735971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081735972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081735972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081735972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:37.380013 run osmo-stp_10.42.42.5(pid=27511): stdout: | (launched: 2022-12-14_08:17:35.798743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:37.502326 run osmo-stp_10.42.42.5(pid=27511): stderr: | 20221214081735971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081735971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081735971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081735971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081735972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081735972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081735972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:37.648871 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27511): Process ended prematurely: osmo-stp_10.42.42.5(pid=27511) [trial-2401↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27511)] [trial-2401↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 08:17:37.657248 tst handover.py:18: Test FAILED (6.5 sec) 08:17:37.683265 run osmo-hlr_10.42.42.2(pid=27508): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27508)] 08:17:37.730425 run osmo-hlr_10.42.42.2(pid=27508): stdout: | (launched: 2022-12-14_08:17:34.848647) 08:17:37.779428 run osmo-hlr_10.42.42.2(pid=27508): stderr: | 20221214081735024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081735024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081735024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081735025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081735025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081735025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081735036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081735045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081735045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081735045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:37.848415 run osmo-msc_10.42.42.6(pid=27514): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27514)] 08:17:37.895845 run osmo-msc_10.42.42.6(pid=27514): stdout: | (launched: 2022-12-14_08:17:36.761049) 08:17:37.945246 run osmo-msc_10.42.42.6(pid=27514): stderr: | 20221214081737029 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081737030 DLGLOBAL DEBUG validating counter group 0x7fc599765c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081737030 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081737030 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081737030 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081737030 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081737032 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081737032 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081737032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081737032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:37.994273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27507): Terminating (SIGTERM) 08:17:38.033796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27510): Terminating (SIGTERM) 08:17:38.073509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27513): Terminating (SIGTERM) 08:17:38.113454 --- ParallelTerminationStrategy: PID 27507 died... 08:17:38.132521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27507): Terminated: ok {rc=0} 08:17:38.176389 --- ParallelTerminationStrategy: PID 27510 died... 08:17:38.194777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27510): Terminated: ok {rc=0} 08:17:38.238394 --- ParallelTerminationStrategy: PID 27513 died... 08:17:38.256866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27513): Terminated: ok {rc=0} 08:17:38.340925 bus /sierra_3: Setting Powered False 08:17:39.439132 bus /sierra_3: Setting Powered False 08:17:40.556404 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 08:17:41.799113 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:41.805309 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:17:41.857572 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:17:41.885250 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:17:41.939200 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:17:41.991192 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:17:42.018570 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:17:42.570770 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 08:17:42.576427 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:42.587929 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:17:42.622734 tst handover.py: using LAC 39611 08:17:42.758450 tst handover.py: using RAC 86 08:17:42.887303 tst handover.py: using CellId 39611 08:17:43.016822 tst handover.py: using BVCI 39612 08:17:43.129356 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:17:43.181031 tst handover.py: using LAC 39612 08:17:43.311053 tst handover.py: using RAC 87 08:17:43.439073 tst handover.py: using CellId 39612 08:17:43.568612 tst handover.py: using BVCI 39613 08:17:43.688940 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:43.700387 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:43.711585 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:43.722824 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:43.734448 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:43.745861 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:17:43.865197 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:17:43.981914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:44.433202 run create_hlr_db(pid=27519): Launched 08:17:44.560757 bus /sierra_2: Setting Powered False 08:17:45.621905 run create_hlr_db(pid=27519): Terminated: ok {rc=0} 08:17:46.043456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27521): Launched 08:17:46.390021 run osmo-hlr_10.42.42.2(pid=27522): Launched 08:17:46.522686 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:47.278599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27524): Launched 08:17:47.594643 run osmo-stp_10.42.42.5(pid=27525): Launched 08:17:47.713398 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:48.244566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27527): Launched 08:17:48.557116 run osmo-msc_10.42.42.6(pid=27528): Launched 08:17:48.731029 run osmo-stp_10.42.42.5(pid=27525): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27525)] 08:17:48.861226 run osmo-stp_10.42.42.5(pid=27525): stdout: | (launched: 2022-12-14_08:17:47.536703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:48.990491 run osmo-stp_10.42.42.5(pid=27525): stderr: | 20221214081747705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081747705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081747705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081747706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081747706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081747706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081747706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:49.118528 run osmo-stp_10.42.42.5(pid=27525): stdout: | (launched: 2022-12-14_08:17:47.536703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:49.240541 run osmo-stp_10.42.42.5(pid=27525): stderr: | 20221214081747705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081747705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081747705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081747706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081747706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081747706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081747706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:49.387152 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27525): Process ended prematurely: osmo-stp_10.42.42.5(pid=27525) [trial-2401↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27525)] [trial-2401↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 08:17:49.395570 tst handover.py:18: Test FAILED (6.8 sec) 08:17:49.421678 run osmo-hlr_10.42.42.2(pid=27522): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27522)] 08:17:49.469391 run osmo-hlr_10.42.42.2(pid=27522): stdout: | (launched: 2022-12-14_08:17:46.331340) 08:17:49.518610 run osmo-hlr_10.42.42.2(pid=27522): stderr: | 20221214081746677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081746677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081746677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081746677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081746677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081746678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081746691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081746707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081746707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081746707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:49.587130 run osmo-msc_10.42.42.6(pid=27528): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27528)] 08:17:49.634287 run osmo-msc_10.42.42.6(pid=27528): stdout: | (launched: 2022-12-14_08:17:48.499220) 08:17:49.683310 run osmo-msc_10.42.42.6(pid=27528): stderr: | 20221214081748770 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081748770 DLGLOBAL DEBUG validating counter group 0x7f202c73bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081748770 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081748770 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081748770 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081748770 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081748772 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081748772 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081748773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081748773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:49.732583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27521): Terminating (SIGTERM) 08:17:49.772766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27524): Terminating (SIGTERM) 08:17:49.812489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27527): Terminating (SIGTERM) 08:17:49.852419 --- ParallelTerminationStrategy: PID 27521 died... 08:17:49.871592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27521): Terminated: ok {rc=0} 08:17:49.915338 --- ParallelTerminationStrategy: PID 27524 died... 08:17:49.934049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27524): Terminated: ok {rc=0} 08:17:49.977585 --- ParallelTerminationStrategy: PID 27527 died... 08:17:49.996168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27527): Terminated: ok {rc=0} 08:17:50.080403 bus /sierra_3: Setting Powered False 08:17:51.179563 bus /sierra_3: Setting Powered False 08:17:52.294050 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 08:17:53.547401 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:53.552526 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:17:53.601961 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:17:53.628467 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:17:53.679910 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:17:53.728840 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:17:53.754998 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:17:54.306639 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 08:17:54.312187 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:54.323373 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:54.357824 tst handover.py: using LAC 39613 08:17:54.488515 tst handover.py: using RAC 88 08:17:54.618101 tst handover.py: using CellId 39613 08:17:54.749194 tst handover.py: using BVCI 39614 08:17:54.870137 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:54.919591 tst handover.py: using LAC 39614 08:17:55.042242 tst handover.py: using RAC 89 08:17:55.165339 tst handover.py: using CellId 39614 08:17:55.286165 tst handover.py: using BVCI 39615 08:17:55.399763 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:55.410845 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:55.421728 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:55.432423 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:55.443181 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:55.453830 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:55.577414 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:55.695159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:56.148593 run create_hlr_db(pid=27534): Launched 08:17:56.274189 bus /sierra_2: Setting Powered False 08:17:57.334968 run create_hlr_db(pid=27534): Terminated: ok {rc=0} 08:17:57.740529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27536): Launched 08:17:58.051221 run osmo-hlr_10.42.42.2(pid=27537): Launched 08:17:58.171359 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:58.674601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27539): Launched 08:17:58.985187 run osmo-stp_10.42.42.5(pid=27540): Launched 08:17:59.103180 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:59.636907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27542): Launched 08:17:59.946351 run osmo-msc_10.42.42.6(pid=27543): Launched 08:18:00.119920 run osmo-stp_10.42.42.5(pid=27540): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27540)] 08:18:00.251168 run osmo-stp_10.42.42.5(pid=27540): stdout: | (launched: 2022-12-14_08:17:58.927953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:00.380386 run osmo-stp_10.42.42.5(pid=27540): stderr: | 20221214081759098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081759098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081759098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081759099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081759099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081759099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081759099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:00.508255 run osmo-stp_10.42.42.5(pid=27540): stdout: | (launched: 2022-12-14_08:17:58.927953) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:00.630444 run osmo-stp_10.42.42.5(pid=27540): stderr: | 20221214081759098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081759098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081759098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081759099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081759099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081759099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081759099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:00.776601 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27540): Process ended prematurely: osmo-stp_10.42.42.5(pid=27540) [trial-2401↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27540)] [trial-2401↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 08:18:00.784844 tst handover.py:18: Test FAILED (6.5 sec) 08:18:00.811302 run osmo-hlr_10.42.42.2(pid=27537): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27537)] 08:18:00.859624 run osmo-hlr_10.42.42.2(pid=27537): stdout: | (launched: 2022-12-14_08:17:57.994280) 08:18:00.909430 run osmo-hlr_10.42.42.2(pid=27537): stderr: | 20221214081758169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081758169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081758169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081758169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081758169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081758169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081758198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081758207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081758207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081758207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:00.979084 run osmo-msc_10.42.42.6(pid=27543): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27543)] 08:18:01.026916 run osmo-msc_10.42.42.6(pid=27543): stdout: | (launched: 2022-12-14_08:17:59.889365) 08:18:01.076723 run osmo-msc_10.42.42.6(pid=27543): stderr: | 20221214081800156 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081800157 DLGLOBAL DEBUG validating counter group 0x7f09a166ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081800157 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081800157 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081800157 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081800157 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081800159 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081800159 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081800160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081800160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:01.126576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27536): Terminating (SIGTERM) 08:18:01.166830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27539): Terminating (SIGTERM) 08:18:01.207095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27542): Terminating (SIGTERM) 08:18:01.247561 --- ParallelTerminationStrategy: PID 27536 died... 08:18:01.266603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27536): Terminated: ok {rc=0} 08:18:01.310882 --- ParallelTerminationStrategy: PID 27539 died... 08:18:01.329675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27539): Terminated: ok {rc=0} 08:18:01.373896 --- ParallelTerminationStrategy: PID 27542 died... 08:18:01.392783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27542): Terminated: ok {rc=0} 08:18:01.476275 bus /sierra_3: Setting Powered False 08:18:02.572326 bus /sierra_3: Setting Powered False 08:18:03.688760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 08:18:04.944389 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:04.950441 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 08:18:05.001736 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 08:18:05.029321 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 08:18:05.084234 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 08:18:05.134881 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 08:18:05.162282 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 08:18:05.710800 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 08:18:05.716572 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:18:05.728174 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:18:05.763294 tst handover.py: using LAC 39615 08:18:05.884481 tst handover.py: using RAC 90 08:18:06.008007 tst handover.py: using CellId 39615 08:18:06.131412 tst handover.py: using BVCI 39616 08:18:06.244816 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:18:06.293459 tst handover.py: using LAC 39616 08:18:06.416439 tst handover.py: using RAC 91 08:18:06.539407 tst handover.py: using CellId 39616 08:18:06.664880 tst handover.py: using BVCI 39617 08:18:06.779036 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:18:06.790184 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:18:06.801064 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:18:06.811785 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:18:06.822544 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:18:06.833448 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:18:06.950172 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:18:07.072842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:07.557564 run create_hlr_db(pid=27548): Launched 08:18:07.688214 bus /sierra_2: Setting Powered False 08:18:08.753515 run create_hlr_db(pid=27548): Terminated: ok {rc=0} 08:18:09.187521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27550): Launched 08:18:09.520056 run osmo-hlr_10.42.42.2(pid=27551): Launched 08:18:09.647133 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:10.188793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27553): Launched 08:18:10.521149 run osmo-stp_10.42.42.5(pid=27554): Launched 08:18:10.649403 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:11.223705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27556): Launched 08:18:11.559702 run osmo-msc_10.42.42.6(pid=27557): Launched 08:18:11.747884 run osmo-stp_10.42.42.5(pid=27554): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27554)] 08:18:11.888347 run osmo-stp_10.42.42.5(pid=27554): stdout: | (launched: 2022-12-14_08:18:10.460346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:12.029114 run osmo-stp_10.42.42.5(pid=27554): stderr: | 20221214081810653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081810653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081810653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081810654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081810654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081810654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081810654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:12.167187 run osmo-stp_10.42.42.5(pid=27554): stdout: | (launched: 2022-12-14_08:18:10.460346) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:12.299623 run osmo-stp_10.42.42.5(pid=27554): stderr: | 20221214081810653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081810653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081810653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081810654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081810654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081810654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081810654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:12.458200 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27554): Process ended prematurely: osmo-stp_10.42.42.5(pid=27554) [trial-2401↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27554)] [trial-2401↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 08:18:12.467316 tst handover.py:18: Test FAILED (6.7 sec) 08:18:12.494800 run osmo-hlr_10.42.42.2(pid=27551): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27551)] 08:18:12.545576 run osmo-hlr_10.42.42.2(pid=27551): stdout: | (launched: 2022-12-14_08:18:09.459700) 08:18:12.597545 run osmo-hlr_10.42.42.2(pid=27551): stderr: | 20221214081809658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081809658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081809658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081809658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081809658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081809658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081809669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081809678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081809678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081809678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:12.670225 run osmo-msc_10.42.42.6(pid=27557): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27557)] 08:18:12.719649 run osmo-msc_10.42.42.6(pid=27557): stdout: | (launched: 2022-12-14_08:18:11.498817) 08:18:12.771283 run osmo-msc_10.42.42.6(pid=27557): stderr: | 20221214081811817 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081811817 DLGLOBAL DEBUG validating counter group 0x7f660533dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081811817 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081811817 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081811817 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081811818 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081811819 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081811820 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081811820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081811820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:12.823929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27550): Terminating (SIGTERM) 08:18:12.866070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27553): Terminating (SIGTERM) 08:18:12.908210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27556): Terminating (SIGTERM) 08:18:12.950845 --- ParallelTerminationStrategy: PID 27550 died... 08:18:12.971337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27550): Terminated: ok {rc=0} 08:18:13.017984 --- ParallelTerminationStrategy: PID 27553 died... 08:18:13.038008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27553): Terminated: ok {rc=0} 08:18:13.084119 --- ParallelTerminationStrategy: PID 27556 died... 08:18:13.104196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27556): Terminated: ok {rc=0} 08:18:13.192920 bus /sierra_3: Setting Powered False 08:18:14.291609 bus /sierra_3: Setting Powered False 08:18:15.407568 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:18:16.666047 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:16.674921 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:18:16.730539 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:18:16.765707 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:18:16.833418 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:18:16.909422 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:18:16.943691 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:18:17.451411 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:18:17.457273 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:18:17.468573 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:18:17.503328 tst handover.py: using LAC 39617 08:18:17.635360 tst handover.py: using RAC 92 08:18:17.767560 tst handover.py: using CellId 39617 08:18:17.898455 tst handover.py: using BVCI 39618 08:18:18.021143 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:18:18.066521 tst handover.py: using LAC 39618 08:18:18.199650 tst handover.py: using RAC 93 08:18:18.322596 tst handover.py: using CellId 39618 08:18:18.446973 tst handover.py: using BVCI 39619 08:18:18.562279 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:18:18.573701 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:18:18.584662 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:18:18.595764 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:18:18.606910 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:18:18.618271 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:18:18.740657 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:18:18.859413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:19.315187 run create_hlr_db(pid=27562): Launched 08:18:19.442031 bus /sierra_2: Setting Powered False 08:18:20.503781 run create_hlr_db(pid=27562): Terminated: ok {rc=0} 08:18:20.910090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27564): Launched 08:18:21.222568 run osmo-hlr_10.42.42.2(pid=27565): Launched 08:18:21.340467 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:21.844618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27567): Launched 08:18:22.154919 run osmo-stp_10.42.42.5(pid=27568): Launched 08:18:22.275322 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:22.807312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27570): Launched 08:18:23.119018 run osmo-msc_10.42.42.6(pid=27571): Launched 08:18:23.291917 run osmo-stp_10.42.42.5(pid=27568): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27568)] 08:18:23.421710 run osmo-stp_10.42.42.5(pid=27568): stdout: | (launched: 2022-12-14_08:18:22.097818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:23.551594 run osmo-stp_10.42.42.5(pid=27568): stderr: | 20221214081822268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081822268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081822268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081822269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081822269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081822269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081822269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:23.680106 run osmo-stp_10.42.42.5(pid=27568): stdout: | (launched: 2022-12-14_08:18:22.097818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:23.802949 run osmo-stp_10.42.42.5(pid=27568): stderr: | 20221214081822268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081822268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081822268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081822269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081822269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081822269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081822269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:23.950370 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27568): Process ended prematurely: osmo-stp_10.42.42.5(pid=27568) [trial-2401↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27568)] [trial-2401↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 08:18:23.958803 tst handover.py:18: Test FAILED (6.5 sec) 08:18:23.984996 run osmo-hlr_10.42.42.2(pid=27565): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27565)] 08:18:24.032893 run osmo-hlr_10.42.42.2(pid=27565): stdout: | (launched: 2022-12-14_08:18:21.164611) 08:18:24.082139 run osmo-hlr_10.42.42.2(pid=27565): stderr: | 20221214081821341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081821341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081821341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081821341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081821341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081821341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081821354 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081821362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081821362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081821362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:24.150908 run osmo-msc_10.42.42.6(pid=27571): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27571)] 08:18:24.198210 run osmo-msc_10.42.42.6(pid=27571): stdout: | (launched: 2022-12-14_08:18:23.061779) 08:18:24.247349 run osmo-msc_10.42.42.6(pid=27571): stderr: | 20221214081823333 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081823333 DLGLOBAL DEBUG validating counter group 0x7f4419afdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081823333 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081823333 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081823333 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081823333 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081823335 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081823335 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081823336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081823336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:24.296749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27564): Terminating (SIGTERM) 08:18:24.336730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27567): Terminating (SIGTERM) 08:18:24.376450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27570): Terminating (SIGTERM) 08:18:24.416357 --- ParallelTerminationStrategy: PID 27564 died... 08:18:24.435655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27564): Terminated: ok {rc=0} 08:18:24.479486 --- ParallelTerminationStrategy: PID 27567 died... 08:18:24.498213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27567): Terminated: ok {rc=0} 08:18:24.541916 --- ParallelTerminationStrategy: PID 27570 died... 08:18:24.560470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27570): Terminated: ok {rc=0} 08:18:24.646478 bus /sierra_3: Setting Powered False 08:18:25.745542 bus /sierra_3: Setting Powered False 08:18:26.858517 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:18:28.115389 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:28.121404 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:18:28.173120 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:18:28.200481 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:18:28.254368 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:18:28.305534 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:18:28.332869 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:18:28.884292 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:18:28.891505 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:18:28.903413 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:18:28.937862 tst handover.py: using LAC 39619 08:18:29.063845 tst handover.py: using RAC 94 08:18:29.188009 tst handover.py: using CellId 39619 08:18:29.310790 tst handover.py: using BVCI 39620 08:18:29.425236 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:18:29.473949 tst handover.py: using LAC 39620 08:18:29.596005 tst handover.py: using RAC 95 08:18:29.718489 tst handover.py: using CellId 39620 08:18:29.845016 tst handover.py: using BVCI 39621 08:18:29.959159 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:18:29.970205 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:18:29.981043 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:18:29.991902 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:18:30.002744 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:18:30.013611 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:18:30.136136 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:18:30.253570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:30.706931 run create_hlr_db(pid=27576): Launched 08:18:30.833480 bus /sierra_2: Setting Powered False 08:18:31.900854 run create_hlr_db(pid=27576): Terminated: ok {rc=0} 08:18:32.348709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27578): Launched 08:18:32.681618 run osmo-hlr_10.42.42.2(pid=27579): Launched 08:18:32.809747 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:33.356357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27581): Launched 08:18:33.688335 run osmo-stp_10.42.42.5(pid=27582): Launched 08:18:33.816101 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:34.385322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27584): Launched 08:18:34.719178 run osmo-msc_10.42.42.6(pid=27585): Launched 08:18:34.906449 run osmo-stp_10.42.42.5(pid=27582): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27582)] 08:18:35.045497 run osmo-stp_10.42.42.5(pid=27582): stdout: | (launched: 2022-12-14_08:18:33.627599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:35.187762 run osmo-stp_10.42.42.5(pid=27582): stderr: | 20221214081833820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081833820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081833820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081833821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081833821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081833821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081833821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:35.326256 run osmo-stp_10.42.42.5(pid=27582): stdout: | (launched: 2022-12-14_08:18:33.627599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:35.458242 run osmo-stp_10.42.42.5(pid=27582): stderr: | 20221214081833820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081833820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081833820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081833821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081833821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081833821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081833821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:35.616083 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27582): Process ended prematurely: osmo-stp_10.42.42.5(pid=27582) [trial-2401↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27582)] [trial-2401↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 08:18:35.625197 tst handover.py:18: Test FAILED (6.7 sec) 08:18:35.652694 run osmo-hlr_10.42.42.2(pid=27579): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27579)] 08:18:35.703438 run osmo-hlr_10.42.42.2(pid=27579): stdout: | (launched: 2022-12-14_08:18:32.620609) 08:18:35.755179 run osmo-hlr_10.42.42.2(pid=27579): stderr: | 20221214081832818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081832819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081832819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081832819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081832819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081832819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081832831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081832840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081832840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081832841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:35.827544 run osmo-msc_10.42.42.6(pid=27585): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27585)] 08:18:35.876899 run osmo-msc_10.42.42.6(pid=27585): stdout: | (launched: 2022-12-14_08:18:34.658403) 08:18:35.928255 run osmo-msc_10.42.42.6(pid=27585): stderr: | 20221214081834979 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081834979 DLGLOBAL DEBUG validating counter group 0x7f2570038c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081834979 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081834979 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081834979 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081834979 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081834981 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081834982 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081834982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081834982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:35.979964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27578): Terminating (SIGTERM) 08:18:36.021854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27581): Terminating (SIGTERM) 08:18:36.064012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27584): Terminating (SIGTERM) 08:18:36.106048 --- ParallelTerminationStrategy: PID 27578 died... 08:18:36.126434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27578): Terminated: ok {rc=0} 08:18:36.172372 --- ParallelTerminationStrategy: PID 27581 died... 08:18:36.191902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27581): Terminated: ok {rc=0} 08:18:36.238344 --- ParallelTerminationStrategy: PID 27584 died... 08:18:36.258266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27584): Terminated: ok {rc=0} 08:18:36.345269 bus /sierra_3: Setting Powered False 08:18:37.443837 bus /sierra_3: Setting Powered False 08:18:38.559259 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 08:18:39.818864 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:39.825800 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:18:39.864605 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:18:39.892460 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:18:39.946457 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:18:39.984187 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:18:40.011615 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:18:40.562286 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 08:18:40.568126 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:40.579605 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 08:18:40.614444 tst handover.py: using LAC 39621 08:18:40.744134 tst handover.py: using RAC 96 08:18:40.877990 tst handover.py: using CellId 39621 08:18:41.007145 tst handover.py: using BVCI 39622 08:18:41.128420 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 08:18:41.162822 tst handover.py: using LAC 39622 08:18:41.292548 tst handover.py: using RAC 97 08:18:41.421522 tst handover.py: using CellId 39622 08:18:41.544731 tst handover.py: using BVCI 39623 08:18:41.658498 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:41.669546 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:41.680284 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:41.690956 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:41.701790 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:18:41.712771 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 08:18:41.835027 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 08:18:41.956679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:42.441171 run create_hlr_db(pid=27590): Launched 08:18:42.567792 bus /sierra_2: Setting Powered False 08:18:43.632604 run create_hlr_db(pid=27590): Terminated: ok {rc=0} 08:18:44.065470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27592): Launched 08:18:44.401389 run osmo-hlr_10.42.42.2(pid=27593): Launched 08:18:44.529379 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:45.073494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27595): Launched 08:18:45.408017 run osmo-stp_10.42.42.5(pid=27596): Launched 08:18:45.536386 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:46.134307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27598): Launched 08:18:46.480823 run osmo-msc_10.42.42.6(pid=27599): Launched 08:18:46.779313 run osmo-stp_10.42.42.5(pid=27596): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27596)] 08:18:46.954009 run osmo-stp_10.42.42.5(pid=27596): stdout: | (launched: 2022-12-14_08:18:45.347198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:47.258231 run osmo-stp_10.42.42.5(pid=27596): stderr: | 20221214081845537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081845537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081845537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081845538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081845538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081845538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081845538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:47.471829 run osmo-stp_10.42.42.5(pid=27596): stdout: | (launched: 2022-12-14_08:18:45.347198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:47.594437 run osmo-stp_10.42.42.5(pid=27596): stderr: | 20221214081845537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081845537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081845537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081845538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081845538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081845538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081845538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:47.741326 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27596): Process ended prematurely: osmo-stp_10.42.42.5(pid=27596) [trial-2401↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27596)] [trial-2401↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 08:18:47.749708 tst handover.py:18: Test FAILED (7.2 sec) 08:18:47.776060 run osmo-hlr_10.42.42.2(pid=27593): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27593)] 08:18:47.824019 run osmo-hlr_10.42.42.2(pid=27593): stdout: | (launched: 2022-12-14_08:18:44.340301) 08:18:47.873719 run osmo-hlr_10.42.42.2(pid=27593): stderr: | 20221214081844539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081844539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081844539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081844539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081844539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081844539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081844552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081844561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081844561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081844561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:47.942656 run osmo-msc_10.42.42.6(pid=27599): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27599)] 08:18:47.990023 run osmo-msc_10.42.42.6(pid=27599): stdout: | (launched: 2022-12-14_08:18:46.420012) 08:18:48.039375 run osmo-msc_10.42.42.6(pid=27599): stderr: | 20221214081847012 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081847012 DLGLOBAL DEBUG validating counter group 0x7f27028f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081847012 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081847013 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081847013 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081847014 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081847020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081847020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081847020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081847020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:48.089071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27592): Terminating (SIGTERM) 08:18:48.129635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27595): Terminating (SIGTERM) 08:18:48.169425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27598): Terminating (SIGTERM) 08:18:48.209385 --- ParallelTerminationStrategy: PID 27592 died... 08:18:48.228515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27592): Terminated: ok {rc=0} 08:18:48.272380 --- ParallelTerminationStrategy: PID 27595 died... 08:18:48.290922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27595): Terminated: ok {rc=0} 08:18:48.334688 --- ParallelTerminationStrategy: PID 27598 died... 08:18:48.353363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27598): Terminated: ok {rc=0} 08:18:48.437303 bus /sierra_3: Setting Powered False 08:18:49.533974 bus /sierra_3: Setting Powered False 08:18:50.648788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 08:18:51.890152 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:18:51.895300 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:18:51.943984 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:18:51.970562 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:18:52.023585 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:18:52.071970 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:18:52.098264 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:18:52.646799 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 08:18:52.651974 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:52.663107 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:18:52.696388 tst handover.py: using LAC 39623 08:18:52.818171 tst handover.py: using RAC 98 08:18:52.941886 tst handover.py: using CellId 39623 08:18:53.062991 tst handover.py: using BVCI 39624 08:18:53.176791 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:18:53.225116 tst handover.py: using LAC 39624 08:18:53.352073 tst handover.py: using RAC 99 08:18:53.473298 tst handover.py: using CellId 39624 08:18:53.594795 tst handover.py: using BVCI 39625 08:18:53.708919 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:53.719768 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:53.730364 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:53.741132 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:53.751788 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:18:53.762366 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:18:53.884036 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:18:54.003085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:18:54.455862 run create_hlr_db(pid=27604): Launched 08:18:54.581406 bus /sierra_2: Setting Powered False 08:18:55.642716 run create_hlr_db(pid=27604): Terminated: ok {rc=0} 08:18:56.066838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27606): Launched 08:18:56.400540 run osmo-hlr_10.42.42.2(pid=27607): Launched 08:18:56.527746 run osmo-stp_10.42.42.5: Starting osmo-stp 08:18:57.067690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27609): Launched 08:18:57.401222 run osmo-stp_10.42.42.5(pid=27610): Launched 08:18:57.530188 run osmo-msc_10.42.42.6: Starting osmo-msc 08:18:58.099560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27612): Launched 08:18:58.433973 run osmo-msc_10.42.42.6(pid=27613): Launched 08:18:58.622346 run osmo-stp_10.42.42.5(pid=27610): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27610)] 08:18:58.761579 run osmo-stp_10.42.42.5(pid=27610): stdout: | (launched: 2022-12-14_08:18:57.340671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:58.901957 run osmo-stp_10.42.42.5(pid=27610): stderr: | 20221214081857532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081857532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081857532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081857532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081857533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081857533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081857533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:59.039679 run osmo-stp_10.42.42.5(pid=27610): stdout: | (launched: 2022-12-14_08:18:57.340671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:18:59.171263 run osmo-stp_10.42.42.5(pid=27610): stderr: | 20221214081857532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081857532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081857532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081857532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081857533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081857533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081857533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:18:59.329341 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27610): Process ended prematurely: osmo-stp_10.42.42.5(pid=27610) [trial-2401↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27610)] [trial-2401↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 08:18:59.338441 tst handover.py:18: Test FAILED (6.7 sec) 08:18:59.366082 run osmo-hlr_10.42.42.2(pid=27607): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27607)] 08:18:59.416938 run osmo-hlr_10.42.42.2(pid=27607): stdout: | (launched: 2022-12-14_08:18:56.339852) 08:18:59.469250 run osmo-hlr_10.42.42.2(pid=27607): stderr: | 20221214081856537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081856537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081856537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081856537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081856537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081856537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081856554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081856563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081856563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081856563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:18:59.537611 run osmo-msc_10.42.42.6(pid=27613): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27613)] 08:18:59.585167 run osmo-msc_10.42.42.6(pid=27613): stdout: | (launched: 2022-12-14_08:18:58.373360) 08:18:59.634013 run osmo-msc_10.42.42.6(pid=27613): stderr: | 20221214081858691 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081858691 DLGLOBAL DEBUG validating counter group 0x7fe3b0cd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081858692 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081858692 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081858692 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081858692 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081858694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081858694 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081858694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081858695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:18:59.683395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27606): Terminating (SIGTERM) 08:18:59.723015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27609): Terminating (SIGTERM) 08:18:59.762795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27612): Terminating (SIGTERM) 08:18:59.802953 --- ParallelTerminationStrategy: PID 27606 died... 08:18:59.822056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27606): Terminated: ok {rc=0} 08:18:59.865670 --- ParallelTerminationStrategy: PID 27609 died... 08:18:59.884016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27609): Terminated: ok {rc=0} 08:18:59.927766 --- ParallelTerminationStrategy: PID 27612 died... 08:18:59.946354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27612): Terminated: ok {rc=0} 08:19:00.030765 bus /sierra_3: Setting Powered False 08:19:01.126811 bus /sierra_3: Setting Powered False 08:19:02.256281 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 08:19:03.513587 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:19:03.519476 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:19:03.570218 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:19:03.597594 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:19:03.651281 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:19:03.699838 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:19:03.726296 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:19:04.279415 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 08:19:04.285749 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:04.297588 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:19:04.332624 tst handover.py: using LAC 39625 08:19:04.468784 tst handover.py: using RAC 100 08:19:04.599158 tst handover.py: using CellId 39625 08:19:04.727569 tst handover.py: using BVCI 39626 08:19:04.848373 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:19:04.900094 tst handover.py: using LAC 39626 08:19:05.029259 tst handover.py: using RAC 101 08:19:05.157227 tst handover.py: using CellId 39626 08:19:05.285652 tst handover.py: using BVCI 39627 08:19:05.401428 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:05.412476 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:05.423558 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:05.434628 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:05.445690 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:19:05.456890 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:19:05.578455 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:19:05.699932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:19:06.155134 run create_hlr_db(pid=27618): Launched 08:19:06.282382 bus /sierra_2: Setting Powered False 08:19:07.344323 run create_hlr_db(pid=27618): Terminated: ok {rc=0} 08:19:07.752157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27620): Launched 08:19:08.063745 run osmo-hlr_10.42.42.2(pid=27621): Launched 08:19:08.182268 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:08.688213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27623): Launched 08:19:08.998172 run osmo-stp_10.42.42.5(pid=27624): Launched 08:19:09.116424 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:09.651429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27626): Launched 08:19:09.963199 run osmo-msc_10.42.42.6(pid=27627): Launched 08:19:10.136739 run osmo-stp_10.42.42.5(pid=27624): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27624)] 08:19:10.266737 run osmo-stp_10.42.42.5(pid=27624): stdout: | (launched: 2022-12-14_08:19:08.941105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:10.396227 run osmo-stp_10.42.42.5(pid=27624): stderr: | 20221214081909110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081909110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081909111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081909111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081909112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081909112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081909112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:10.524756 run osmo-stp_10.42.42.5(pid=27624): stdout: | (launched: 2022-12-14_08:19:08.941105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:10.647653 run osmo-stp_10.42.42.5(pid=27624): stderr: | 20221214081909110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081909110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081909111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081909111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081909112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081909112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081909112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:10.794864 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27624): Process ended prematurely: osmo-stp_10.42.42.5(pid=27624) [trial-2401↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27624)] [trial-2401↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 08:19:10.803297 tst handover.py:18: Test FAILED (6.5 sec) 08:19:10.829630 run osmo-hlr_10.42.42.2(pid=27621): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27621)] 08:19:10.877670 run osmo-hlr_10.42.42.2(pid=27621): stdout: | (launched: 2022-12-14_08:19:08.006839) 08:19:10.927076 run osmo-hlr_10.42.42.2(pid=27621): stderr: | 20221214081908183 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081908183 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081908183 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081908183 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081908183 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081908183 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081908196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081908204 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081908205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081908205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:10.996172 run osmo-msc_10.42.42.6(pid=27627): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27627)] 08:19:11.045002 run osmo-msc_10.42.42.6(pid=27627): stdout: | (launched: 2022-12-14_08:19:09.906124) 08:19:11.094406 run osmo-msc_10.42.42.6(pid=27627): stderr: | 20221214081910174 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081910174 DLGLOBAL DEBUG validating counter group 0x7fbfbf2bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081910174 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081910174 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081910174 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081910175 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081910176 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081910177 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081910177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081910177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:11.143940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27620): Terminating (SIGTERM) 08:19:11.183863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27623): Terminating (SIGTERM) 08:19:11.223611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27626): Terminating (SIGTERM) 08:19:11.263899 --- ParallelTerminationStrategy: PID 27620 died... 08:19:11.283264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27620): Terminated: ok {rc=0} 08:19:11.327483 --- ParallelTerminationStrategy: PID 27623 died... 08:19:11.346163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27623): Terminated: ok {rc=0} 08:19:11.390481 --- ParallelTerminationStrategy: PID 27626 died... 08:19:11.409225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27626): Terminated: ok {rc=0} 08:19:11.495001 bus /sierra_3: Setting Powered False 08:19:12.594869 bus /sierra_3: Setting Powered False 08:19:13.706728 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:19:14.963668 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:19:14.969815 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:19:15.031274 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:19:15.058894 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:19:15.112536 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:19:15.173136 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:19:15.200288 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:19:15.753261 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:19:15.759135 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:19:15.771084 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:19:15.824086 tst handover.py: using LAC 39627 08:19:15.988556 tst handover.py: using RAC 102 08:19:16.111988 tst handover.py: using CellId 39627 08:19:16.245668 tst handover.py: using BVCI 39628 08:19:16.391128 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:19:16.435163 tst handover.py: using LAC 39628 08:19:16.593126 tst handover.py: using RAC 103 08:19:16.726558 tst handover.py: using CellId 39628 08:19:16.849900 tst handover.py: using BVCI 39629 08:19:16.992879 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:19:17.005779 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:19:17.018341 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:19:17.031144 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:19:17.044695 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:19:17.058577 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:19:17.187977 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:19:17.306655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:19:17.761480 run create_hlr_db(pid=27632): Launched 08:19:17.888563 bus /sierra_2: Setting Powered False 08:19:18.950250 run create_hlr_db(pid=27632): Terminated: ok {rc=0} 08:19:19.355479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27634): Launched 08:19:19.670413 run osmo-hlr_10.42.42.2(pid=27635): Launched 08:19:19.786441 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:20.283675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27637): Launched 08:19:20.589054 run osmo-stp_10.42.42.5(pid=27638): Launched 08:19:20.705189 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:21.229597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27640): Launched 08:19:21.539709 run osmo-msc_10.42.42.6(pid=27641): Launched 08:19:21.709196 run osmo-stp_10.42.42.5(pid=27638): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27638)] 08:19:21.843078 run osmo-stp_10.42.42.5(pid=27638): stdout: | (launched: 2022-12-14_08:19:20.532637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:21.983727 run osmo-stp_10.42.42.5(pid=27638): stderr: | 20221214081920699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081920699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081920700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081920700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081920700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081920701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081920701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:22.110656 run osmo-stp_10.42.42.5(pid=27638): stdout: | (launched: 2022-12-14_08:19:20.532637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:22.231906 run osmo-stp_10.42.42.5(pid=27638): stderr: | 20221214081920699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081920699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081920700 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081920700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081920700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081920701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081920701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:22.377310 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27638): Process ended prematurely: osmo-stp_10.42.42.5(pid=27638) [trial-2401↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27638)] [trial-2401↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 08:19:22.385582 tst handover.py:18: Test FAILED (6.6 sec) 08:19:22.411695 run osmo-hlr_10.42.42.2(pid=27635): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27635)] 08:19:22.459186 run osmo-hlr_10.42.42.2(pid=27635): stdout: | (launched: 2022-12-14_08:19:19.613145) 08:19:22.508596 run osmo-hlr_10.42.42.2(pid=27635): stderr: | 20221214081919788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081919788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081919788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081919788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081919788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081919788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081919800 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081919808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081919808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081919808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:22.576877 run osmo-msc_10.42.42.6(pid=27641): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27641)] 08:19:22.624108 run osmo-msc_10.42.42.6(pid=27641): stdout: | (launched: 2022-12-14_08:19:21.481938) 08:19:22.672773 run osmo-msc_10.42.42.6(pid=27641): stderr: | 20221214081921754 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081921754 DLGLOBAL DEBUG validating counter group 0x7f8bf21b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081921754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081921754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081921754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081921754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081921756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081921756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081921756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081921757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:22.721782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27634): Terminating (SIGTERM) 08:19:22.760848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27637): Terminating (SIGTERM) 08:19:22.799963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27640): Terminating (SIGTERM) 08:19:22.839451 --- ParallelTerminationStrategy: PID 27634 died... 08:19:22.858537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27634): Terminated: ok {rc=0} 08:19:22.902715 --- ParallelTerminationStrategy: PID 27637 died... 08:19:22.921084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27637): Terminated: ok {rc=0} 08:19:22.964296 --- ParallelTerminationStrategy: PID 27640 died... 08:19:22.982802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27640): Terminated: ok {rc=0} 08:19:23.067155 bus /sierra_3: Setting Powered False 08:19:24.164676 bus /sierra_3: Setting Powered False 08:19:25.278405 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:19:26.544730 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:19:26.549953 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:19:26.612398 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:19:26.638864 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:19:26.690829 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:19:26.752801 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:19:26.778875 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:19:27.329349 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:19:27.334569 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:19:27.345710 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:19:27.394017 tst handover.py: using LAC 39629 08:19:27.523884 tst handover.py: using RAC 104 08:19:27.644413 tst handover.py: using CellId 39629 08:19:27.764198 tst handover.py: using BVCI 39630 08:19:27.876448 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:19:27.925557 tst handover.py: using LAC 39630 08:19:28.046384 tst handover.py: using RAC 105 08:19:28.167483 tst handover.py: using CellId 39630 08:19:28.288537 tst handover.py: using BVCI 39631 08:19:28.399246 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:19:28.410188 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:19:28.420849 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:19:28.431661 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:19:28.442443 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:19:28.453731 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:19:28.575929 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:19:28.698774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:19:29.178184 run create_hlr_db(pid=27646): Launched 08:19:29.303815 bus /sierra_2: Setting Powered False 08:19:30.367719 run create_hlr_db(pid=27646): Terminated: ok {rc=0} 08:19:30.777116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27648): Launched 08:19:31.114154 run osmo-hlr_10.42.42.2(pid=27649): Launched 08:19:31.269855 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:32.046550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27651): Launched 08:19:32.436677 run osmo-stp_10.42.42.5(pid=27652): Launched 08:19:32.551720 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:33.074296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27654): Launched 08:19:33.378472 run osmo-msc_10.42.42.6(pid=27655): Launched 08:19:33.547814 run osmo-stp_10.42.42.5(pid=27652): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27652)] 08:19:33.675914 run osmo-stp_10.42.42.5(pid=27652): stdout: | (launched: 2022-12-14_08:19:32.381066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:33.803156 run osmo-stp_10.42.42.5(pid=27652): stderr: | 20221214081932548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081932548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081932548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081932549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081932549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081932549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081932549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:33.928802 run osmo-stp_10.42.42.5(pid=27652): stdout: | (launched: 2022-12-14_08:19:32.381066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:34.048529 run osmo-stp_10.42.42.5(pid=27652): stderr: | 20221214081932548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081932548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081932548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081932549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081932549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081932549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081932549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:34.192590 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27652): Process ended prematurely: osmo-stp_10.42.42.5(pid=27652) [trial-2401↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27652)] [trial-2401↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 08:19:34.200881 tst handover.py:18: Test FAILED (6.9 sec) 08:19:34.226769 run osmo-hlr_10.42.42.2(pid=27649): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27649)] 08:19:34.274550 run osmo-hlr_10.42.42.2(pid=27649): stdout: | (launched: 2022-12-14_08:19:31.043864) 08:19:34.323701 run osmo-hlr_10.42.42.2(pid=27649): stderr: | 20221214081931407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081931407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081931407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081931407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081931407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081931407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081931431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081931443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081931444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081931444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:34.392327 run osmo-msc_10.42.42.6(pid=27655): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27655)] 08:19:34.439539 run osmo-msc_10.42.42.6(pid=27655): stdout: | (launched: 2022-12-14_08:19:33.322424) 08:19:34.488523 run osmo-msc_10.42.42.6(pid=27655): stderr: | 20221214081933591 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081933591 DLGLOBAL DEBUG validating counter group 0x7f53bbad8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081933591 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081933591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081933591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081933591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081933593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081933594 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081933594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081933594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:34.537986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27648): Terminating (SIGTERM) 08:19:34.577386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27651): Terminating (SIGTERM) 08:19:34.616884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27654): Terminating (SIGTERM) 08:19:34.656671 --- ParallelTerminationStrategy: PID 27648 died... 08:19:34.676004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27648): Terminated: ok {rc=0} 08:19:34.719759 --- ParallelTerminationStrategy: PID 27651 died... 08:19:34.738437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27651): Terminated: ok {rc=0} 08:19:34.781826 --- ParallelTerminationStrategy: PID 27654 died... 08:19:34.800020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27654): Terminated: ok {rc=0} 08:19:34.884280 bus /sierra_3: Setting Powered False 08:19:35.984433 bus /sierra_3: Setting Powered False 08:19:37.099309 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 08:19:38.373550 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:19:38.379086 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:19:38.431265 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:19:38.458412 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:19:38.510650 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:19:38.563164 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:19:38.590455 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:19:39.135999 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 08:19:39.142381 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:19:39.153748 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 08:19:39.201375 tst handover.py: using LAC 39631 08:19:39.332463 tst handover.py: using RAC 106 08:19:39.474250 tst handover.py: using CellId 39631 08:19:39.602824 tst handover.py: using BVCI 39632 08:19:39.721486 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 08:19:39.757127 tst handover.py: using LAC 39632 08:19:39.887359 tst handover.py: using RAC 107 08:19:40.013115 tst handover.py: using CellId 39632 08:19:40.131951 tst handover.py: using BVCI 39633 08:19:40.243326 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:19:40.254239 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:19:40.265128 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:19:40.275851 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:19:40.286677 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:19:40.297991 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 08:19:40.419295 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 08:19:40.537505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:19:41.007617 run create_hlr_db(pid=27661): Launched 08:19:41.130516 bus /sierra_2: Setting Powered False 08:19:42.194127 run create_hlr_db(pid=27661): Terminated: ok {rc=0} 08:19:42.615037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27663): Launched 08:19:42.937762 run osmo-hlr_10.42.42.2(pid=27664): Launched 08:19:43.060104 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:43.586869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27666): Launched 08:19:43.908712 run osmo-stp_10.42.42.5(pid=27667): Launched 08:19:44.032135 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:44.587241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27669): Launched 08:19:44.909986 run osmo-msc_10.42.42.6(pid=27670): Launched 08:19:45.092058 run osmo-stp_10.42.42.5(pid=27667): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27667)] 08:19:45.229591 run osmo-stp_10.42.42.5(pid=27667): stdout: | (launched: 2022-12-14_08:19:43.849765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:45.367884 run osmo-stp_10.42.42.5(pid=27667): stderr: | 20221214081944037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081944037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081944037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081944038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081944038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081944038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081944038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:45.503453 run osmo-stp_10.42.42.5(pid=27667): stdout: | (launched: 2022-12-14_08:19:43.849765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:45.632357 run osmo-stp_10.42.42.5(pid=27667): stderr: | 20221214081944037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081944037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081944037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081944038 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081944038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081944038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081944038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:45.787583 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27667): Process ended prematurely: osmo-stp_10.42.42.5(pid=27667) [trial-2401↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27667)] [trial-2401↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 08:19:45.796340 tst handover.py:18: Test FAILED (6.6 sec) 08:19:45.823697 run osmo-hlr_10.42.42.2(pid=27664): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27664)] 08:19:45.886517 run osmo-hlr_10.42.42.2(pid=27664): stdout: | (launched: 2022-12-14_08:19:42.879264) 08:19:45.942063 run osmo-hlr_10.42.42.2(pid=27664): stderr: | 20221214081943072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081943072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081943072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081943072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081943072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081943072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081943084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081943092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081943093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081943093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:46.013832 run osmo-msc_10.42.42.6(pid=27670): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27670)] 08:19:46.062911 run osmo-msc_10.42.42.6(pid=27670): stdout: | (launched: 2022-12-14_08:19:44.850806) 08:19:46.113273 run osmo-msc_10.42.42.6(pid=27670): stderr: | 20221214081945167 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081945167 DLGLOBAL DEBUG validating counter group 0x7fb93c77bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081945167 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081945167 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081945167 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081945167 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081945169 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081945170 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081945170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081945170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:46.165272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27663): Terminating (SIGTERM) 08:19:46.206706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27666): Terminating (SIGTERM) 08:19:46.249959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27669): Terminating (SIGTERM) 08:19:46.293150 --- ParallelTerminationStrategy: PID 27663 died... 08:19:46.314007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27663): Terminated: ok {rc=0} 08:19:46.360079 --- ParallelTerminationStrategy: PID 27666 died... 08:19:46.380525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27666): Terminated: ok {rc=0} 08:19:46.425197 --- ParallelTerminationStrategy: PID 27669 died... 08:19:46.444499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27669): Terminated: ok {rc=0} 08:19:46.530376 bus /sierra_3: Setting Powered False 08:19:47.627100 bus /sierra_3: Setting Powered False 08:19:48.740565 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 08:19:49.992701 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:19:49.998042 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:19:50.059383 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:19:50.085597 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:19:50.137769 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:19:50.202296 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:19:50.229559 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:19:50.775286 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 08:19:50.780816 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:50.791843 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:19:50.838943 tst handover.py: using LAC 39633 08:19:50.959257 tst handover.py: using RAC 108 08:19:51.079867 tst handover.py: using CellId 39633 08:19:51.202401 tst handover.py: using BVCI 39634 08:19:51.313257 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:19:51.361189 tst handover.py: using LAC 39634 08:19:51.479721 tst handover.py: using RAC 109 08:19:51.600207 tst handover.py: using CellId 39634 08:19:51.730907 tst handover.py: using BVCI 39635 08:19:51.850611 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:51.862433 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:51.874263 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:51.885914 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:51.897829 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:19:51.909561 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:19:52.028938 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:19:52.149232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:19:52.624839 run create_hlr_db(pid=27675): Launched 08:19:52.750016 bus /sierra_2: Setting Powered False 08:19:53.813483 run create_hlr_db(pid=27675): Terminated: ok {rc=0} 08:19:54.221915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27677): Launched 08:19:54.526087 run osmo-hlr_10.42.42.2(pid=27678): Launched 08:19:54.642555 run osmo-stp_10.42.42.5: Starting osmo-stp 08:19:55.138927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27680): Launched 08:19:55.443416 run osmo-stp_10.42.42.5(pid=27681): Launched 08:19:55.559570 run osmo-msc_10.42.42.6: Starting osmo-msc 08:19:56.085699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27683): Launched 08:19:56.393149 run osmo-msc_10.42.42.6(pid=27684): Launched 08:19:56.564016 run osmo-stp_10.42.42.5(pid=27681): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27681)] 08:19:56.693212 run osmo-stp_10.42.42.5(pid=27681): stdout: | (launched: 2022-12-14_08:19:55.387623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:56.821487 run osmo-stp_10.42.42.5(pid=27681): stderr: | 20221214081955554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081955554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081955554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081955554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081955555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081955555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081955555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:56.947422 run osmo-stp_10.42.42.5(pid=27681): stdout: | (launched: 2022-12-14_08:19:55.387623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:19:57.067534 run osmo-stp_10.42.42.5(pid=27681): stderr: | 20221214081955554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214081955554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214081955554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214081955554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214081955555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214081955555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214081955555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:19:57.211894 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27681): Process ended prematurely: osmo-stp_10.42.42.5(pid=27681) [trial-2401↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27681)] [trial-2401↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 08:19:57.220171 tst handover.py:18: Test FAILED (6.4 sec) 08:19:57.246148 run osmo-hlr_10.42.42.2(pid=27678): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27678)] 08:19:57.293624 run osmo-hlr_10.42.42.2(pid=27678): stdout: | (launched: 2022-12-14_08:19:54.470293) 08:19:57.342619 run osmo-hlr_10.42.42.2(pid=27678): stderr: | 20221214081954643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214081954643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214081954643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214081954643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214081954643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214081954643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214081954669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214081954677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214081954678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214081954678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:19:57.411042 run osmo-msc_10.42.42.6(pid=27684): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27684)] 08:19:57.458392 run osmo-msc_10.42.42.6(pid=27684): stdout: | (launched: 2022-12-14_08:19:56.336636) 08:19:57.507546 run osmo-msc_10.42.42.6(pid=27684): stderr: | 20221214081956605 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214081956605 DLGLOBAL DEBUG validating counter group 0x7fcaebc08c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214081956605 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214081956606 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214081956606 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214081956606 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214081956608 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214081956608 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214081956608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214081956608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:19:57.557074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27677): Terminating (SIGTERM) 08:19:57.596508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27680): Terminating (SIGTERM) 08:19:57.635804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27683): Terminating (SIGTERM) 08:19:57.675641 --- ParallelTerminationStrategy: PID 27677 died... 08:19:57.694873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27677): Terminated: ok {rc=0} 08:19:57.738663 --- ParallelTerminationStrategy: PID 27680 died... 08:19:57.757346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27680): Terminated: ok {rc=0} 08:19:57.800792 --- ParallelTerminationStrategy: PID 27683 died... 08:19:57.819493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27683): Terminated: ok {rc=0} 08:19:57.904892 bus /sierra_3: Setting Powered False 08:19:59.003770 bus /sierra_3: Setting Powered False 08:20:00.116029 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 08:20:01.424585 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:20:01.431436 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:20:01.499928 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:20:01.528561 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:20:01.585854 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:20:01.666562 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:20:01.702735 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:20:02.234643 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 08:20:02.241686 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:02.253207 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:20:02.303519 tst handover.py: using LAC 39635 08:20:02.422702 tst handover.py: using RAC 110 08:20:02.542350 tst handover.py: using CellId 39635 08:20:02.665320 tst handover.py: using BVCI 39636 08:20:02.776227 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:20:02.823768 tst handover.py: using LAC 39636 08:20:02.952864 tst handover.py: using RAC 111 08:20:03.079723 tst handover.py: using CellId 39636 08:20:03.206986 tst handover.py: using BVCI 39637 08:20:03.325931 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:03.337202 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:03.348171 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:03.359216 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:03.371270 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:03.383169 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:20:03.502214 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:20:03.622275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:20:04.098029 run create_hlr_db(pid=27692): Launched 08:20:04.222002 bus /sierra_2: Setting Powered False 08:20:05.285954 run create_hlr_db(pid=27692): Terminated: ok {rc=0} 08:20:05.693972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27694): Launched 08:20:05.998240 run osmo-hlr_10.42.42.2(pid=27695): Launched 08:20:06.113121 run osmo-stp_10.42.42.5: Starting osmo-stp 08:20:06.611944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27697): Launched 08:20:06.915782 run osmo-stp_10.42.42.5(pid=27698): Launched 08:20:07.031014 run osmo-msc_10.42.42.6: Starting osmo-msc 08:20:07.553225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27700): Launched 08:20:07.858128 run osmo-msc_10.42.42.6(pid=27701): Launched 08:20:08.027704 run osmo-stp_10.42.42.5(pid=27698): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27698)] 08:20:08.154842 run osmo-stp_10.42.42.5(pid=27698): stdout: | (launched: 2022-12-14_08:20:06.860135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:08.281734 run osmo-stp_10.42.42.5(pid=27698): stderr: | 20221214082007026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082007026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082007027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082007027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082007027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082007028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082007028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:08.407309 run osmo-stp_10.42.42.5(pid=27698): stdout: | (launched: 2022-12-14_08:20:06.860135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:08.527493 run osmo-stp_10.42.42.5(pid=27698): stderr: | 20221214082007026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082007026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082007027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082007027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082007027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082007028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082007028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:08.671977 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27698): Process ended prematurely: osmo-stp_10.42.42.5(pid=27698) [trial-2401↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27698)] [trial-2401↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 08:20:08.680313 tst handover.py:18: Test FAILED (6.4 sec) 08:20:08.706295 run osmo-hlr_10.42.42.2(pid=27695): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27695)] 08:20:08.753649 run osmo-hlr_10.42.42.2(pid=27695): stdout: | (launched: 2022-12-14_08:20:05.942645) 08:20:08.802561 run osmo-hlr_10.42.42.2(pid=27695): stderr: | 20221214082006114 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082006114 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082006114 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082006114 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082006115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082006115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082006127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082006135 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082006135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082006135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:20:08.871208 run osmo-msc_10.42.42.6(pid=27701): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27701)] 08:20:08.918430 run osmo-msc_10.42.42.6(pid=27701): stdout: | (launched: 2022-12-14_08:20:07.801596) 08:20:08.966999 run osmo-msc_10.42.42.6(pid=27701): stderr: | 20221214082008071 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082008072 DLGLOBAL DEBUG validating counter group 0x7f3b1dd15c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082008072 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082008072 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082008072 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082008072 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082008074 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082008074 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082008074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082008075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:20:09.016119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27694): Terminating (SIGTERM) 08:20:09.055564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27697): Terminating (SIGTERM) 08:20:09.094991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27700): Terminating (SIGTERM) 08:20:09.134604 --- ParallelTerminationStrategy: PID 27694 died... 08:20:09.153610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27694): Terminated: ok {rc=0} 08:20:09.197799 --- ParallelTerminationStrategy: PID 27697 died... 08:20:09.216288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27697): Terminated: ok {rc=0} 08:20:09.259767 --- ParallelTerminationStrategy: PID 27700 died... 08:20:09.278364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27700): Terminated: ok {rc=0} 08:20:09.361837 bus /sierra_3: Setting Powered False 08:20:10.459460 bus /sierra_3: Setting Powered False 08:20:11.574827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:20:12.839126 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:20:12.844481 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:20:12.902428 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:20:12.928426 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:20:12.978382 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:20:13.036832 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:20:13.062899 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:20:13.617433 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:20:13.622586 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:20:13.633830 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:20:13.677866 tst handover.py: using LAC 39637 08:20:13.795813 tst handover.py: using RAC 112 08:20:13.914099 tst handover.py: using CellId 39637 08:20:14.031395 tst handover.py: using BVCI 39638 08:20:14.140884 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:20:14.192903 tst handover.py: using LAC 39638 08:20:14.321134 tst handover.py: using RAC 113 08:20:14.446823 tst handover.py: using CellId 39638 08:20:14.572899 tst handover.py: using BVCI 39639 08:20:14.691470 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:20:14.703322 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:20:14.714941 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:20:14.726665 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:20:14.738384 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:20:14.750407 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:20:14.867453 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:20:14.985562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:20:15.429652 run create_hlr_db(pid=27707): Launched 08:20:15.555896 bus /sierra_2: Setting Powered False 08:20:16.622927 run create_hlr_db(pid=27707): Terminated: ok {rc=0} 08:20:17.056561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27709): Launched 08:20:17.387380 run osmo-hlr_10.42.42.2(pid=27710): Launched 08:20:17.502869 run osmo-stp_10.42.42.5: Starting osmo-stp 08:20:18.013264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27712): Launched 08:20:18.315345 run osmo-stp_10.42.42.5(pid=27713): Launched 08:20:18.429741 run osmo-msc_10.42.42.6: Starting osmo-msc 08:20:18.952693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27715): Launched 08:20:19.255387 run osmo-msc_10.42.42.6(pid=27716): Launched 08:20:19.426759 run osmo-stp_10.42.42.5(pid=27713): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27713)] 08:20:19.554891 run osmo-stp_10.42.42.5(pid=27713): stdout: | (launched: 2022-12-14_08:20:18.260165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:19.682837 run osmo-stp_10.42.42.5(pid=27713): stderr: | 20221214082018428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082018428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082018428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082018429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082018429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082018429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082018429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:19.809592 run osmo-stp_10.42.42.5(pid=27713): stdout: | (launched: 2022-12-14_08:20:18.260165) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:19.931165 run osmo-stp_10.42.42.5(pid=27713): stderr: | 20221214082018428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082018428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082018428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082018429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082018429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082018429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082018429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:20.076216 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27713): Process ended prematurely: osmo-stp_10.42.42.5(pid=27713) [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27713)] [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 08:20:20.084314 tst handover.py:18: Test FAILED (6.5 sec) 08:20:20.110171 run osmo-hlr_10.42.42.2(pid=27710): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27710)] 08:20:20.156790 run osmo-hlr_10.42.42.2(pid=27710): stdout: | (launched: 2022-12-14_08:20:17.331992) 08:20:20.205372 run osmo-hlr_10.42.42.2(pid=27710): stderr: | 20221214082017504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082017504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082017504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082017504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082017504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082017504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082017516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082017527 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082017527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082017527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:20:20.273368 run osmo-msc_10.42.42.6(pid=27716): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27716)] 08:20:20.319924 run osmo-msc_10.42.42.6(pid=27716): stdout: | (launched: 2022-12-14_08:20:19.200012) 08:20:20.368251 run osmo-msc_10.42.42.6(pid=27716): stderr: | 20221214082019468 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082019468 DLGLOBAL DEBUG validating counter group 0x7f49b67bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082019468 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082019468 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082019468 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082019469 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082019470 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082019471 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082019471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082019471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:20:20.416916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27709): Terminating (SIGTERM) 08:20:20.455906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27712): Terminating (SIGTERM) 08:20:20.494953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27715): Terminating (SIGTERM) 08:20:20.534240 --- ParallelTerminationStrategy: PID 27709 died... 08:20:20.552860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27709): Terminated: ok {rc=0} 08:20:20.596181 --- ParallelTerminationStrategy: PID 27712 died... 08:20:20.614401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27712): Terminated: ok {rc=0} 08:20:20.657256 --- ParallelTerminationStrategy: PID 27715 died... 08:20:20.675337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27715): Terminated: ok {rc=0} 08:20:20.760016 bus /sierra_3: Setting Powered False 08:20:21.857861 bus /sierra_3: Setting Powered False 08:20:22.970983 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 08:20:24.246746 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:20:24.252405 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:20:24.300784 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:20:24.328041 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:20:24.379774 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:20:24.428084 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:20:24.455319 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:20:25.010701 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 08:20:25.016533 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:20:25.028187 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 08:20:25.074858 tst handover.py: using LAC 39639 08:20:25.205090 tst handover.py: using RAC 114 08:20:25.337368 tst handover.py: using CellId 39639 08:20:25.466325 tst handover.py: using BVCI 39640 08:20:25.586241 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 08:20:25.621340 tst handover.py: using LAC 39640 08:20:25.749197 tst handover.py: using RAC 115 08:20:25.876812 tst handover.py: using CellId 39640 08:20:26.005147 tst handover.py: using BVCI 39641 08:20:26.124669 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:20:26.136467 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:20:26.148027 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:20:26.159703 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:20:26.171625 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:20:26.183425 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 08:20:26.303144 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 08:20:26.424418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:20:26.906087 run create_hlr_db(pid=27721): Launched 08:20:27.032655 bus /sierra_2: Setting Powered False 08:20:28.098179 run create_hlr_db(pid=27721): Terminated: ok {rc=0} 08:20:28.511290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27723): Launched 08:20:28.818649 run osmo-hlr_10.42.42.2(pid=27724): Launched 08:20:28.935948 run osmo-stp_10.42.42.5: Starting osmo-stp 08:20:29.450850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27726): Launched 08:20:29.758233 run osmo-stp_10.42.42.5(pid=27727): Launched 08:20:29.876062 run osmo-msc_10.42.42.6: Starting osmo-msc 08:20:30.405019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27729): Launched 08:20:30.712550 run osmo-msc_10.42.42.6(pid=27730): Launched 08:20:30.888884 run osmo-stp_10.42.42.5(pid=27727): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27727)] 08:20:31.191889 run osmo-stp_10.42.42.5(pid=27727): stdout: | (launched: 2022-12-14_08:20:29.701983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:31.579261 run osmo-stp_10.42.42.5(pid=27727): stderr: | 20221214082029869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082029869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082029870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082029870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082029871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082029871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082029871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:31.772771 run osmo-stp_10.42.42.5(pid=27727): stdout: | (launched: 2022-12-14_08:20:29.701983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:31.933560 run osmo-stp_10.42.42.5(pid=27727): stderr: | 20221214082029869 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082029869 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082029870 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082029870 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082029871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082029871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082029871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:32.106392 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27727): Process ended prematurely: osmo-stp_10.42.42.5(pid=27727) [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27727)] [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 08:20:32.115384 tst handover.py:18: Test FAILED (7.1 sec) 08:20:32.142543 run osmo-hlr_10.42.42.2(pid=27724): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27724)] 08:20:32.191299 run osmo-hlr_10.42.42.2(pid=27724): stdout: | (launched: 2022-12-14_08:20:28.762073) 08:20:32.241228 run osmo-hlr_10.42.42.2(pid=27724): stderr: | 20221214082028934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082028934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082028934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082028934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082028934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082028934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082028947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082028955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082028955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082028955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:20:32.311085 run osmo-msc_10.42.42.6(pid=27730): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27730)] 08:20:32.358749 run osmo-msc_10.42.42.6(pid=27730): stdout: | (launched: 2022-12-14_08:20:30.655783) 08:20:32.407383 run osmo-msc_10.42.42.6(pid=27730): stderr: | 20221214082031078 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082031079 DLGLOBAL DEBUG validating counter group 0x7f1280acac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082031080 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082031080 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082031080 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082031081 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082031087 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082031089 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082031089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082031089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:20:32.456864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27723): Terminating (SIGTERM) 08:20:32.496336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27726): Terminating (SIGTERM) 08:20:32.535634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27729): Terminating (SIGTERM) 08:20:32.575498 --- ParallelTerminationStrategy: PID 27723 died... 08:20:32.594608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27723): Terminated: ok {rc=0} 08:20:32.638419 --- ParallelTerminationStrategy: PID 27726 died... 08:20:32.656695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27726): Terminated: ok {rc=0} 08:20:32.700408 --- ParallelTerminationStrategy: PID 27729 died... 08:20:32.718793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27729): Terminated: ok {rc=0} 08:20:32.803897 bus /sierra_3: Setting Powered False 08:20:33.903578 bus /sierra_3: Setting Powered False 08:20:35.020731 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 08:20:36.270172 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:20:36.275346 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:20:36.333638 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:20:36.360063 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:20:36.411999 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:20:36.470757 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:20:36.497229 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:20:37.049031 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 08:20:37.054421 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:20:37.065738 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:20:37.109023 tst handover.py: using LAC 39641 08:20:37.229348 tst handover.py: using RAC 116 08:20:37.348709 tst handover.py: using CellId 39641 08:20:37.470321 tst handover.py: using BVCI 39642 08:20:37.582544 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:20:37.630726 tst handover.py: using LAC 39642 08:20:37.761376 tst handover.py: using RAC 117 08:20:37.891223 tst handover.py: using CellId 39642 08:20:38.020725 tst handover.py: using BVCI 39643 08:20:38.140810 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:20:38.152737 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:20:38.164120 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:20:38.175526 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:20:38.186901 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:20:38.198563 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:20:38.317104 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:20:38.435015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:20:38.883986 run create_hlr_db(pid=27735): Launched 08:20:39.010831 bus /sierra_2: Setting Powered False 08:20:40.071911 run create_hlr_db(pid=27735): Terminated: ok {rc=0} 08:20:40.494151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27737): Launched 08:20:40.826159 run osmo-hlr_10.42.42.2(pid=27738): Launched 08:20:40.952498 run osmo-stp_10.42.42.5: Starting osmo-stp 08:20:41.493330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27740): Launched 08:20:41.823194 run osmo-stp_10.42.42.5(pid=27741): Launched 08:20:41.987451 run osmo-msc_10.42.42.6: Starting osmo-msc 08:20:42.552853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27743): Launched 08:20:42.883286 run osmo-msc_10.42.42.6(pid=27744): Launched 08:20:43.067966 run osmo-stp_10.42.42.5(pid=27741): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27741)] 08:20:43.207151 run osmo-stp_10.42.42.5(pid=27741): stdout: | (launched: 2022-12-14_08:20:41.763047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:43.347270 run osmo-stp_10.42.42.5(pid=27741): stderr: | 20221214082041986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082041986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082041986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082041987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082041987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082041987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082041987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:43.484256 run osmo-stp_10.42.42.5(pid=27741): stdout: | (launched: 2022-12-14_08:20:41.763047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:43.614938 run osmo-stp_10.42.42.5(pid=27741): stderr: | 20221214082041986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082041986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082041986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082041987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082041987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082041987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082041987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:43.771478 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27741): Process ended prematurely: osmo-stp_10.42.42.5(pid=27741) [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27741)] [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 08:20:43.780302 tst handover.py:18: Test FAILED (6.7 sec) 08:20:43.807620 run osmo-hlr_10.42.42.2(pid=27738): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27738)] 08:20:43.857682 run osmo-hlr_10.42.42.2(pid=27738): stdout: | (launched: 2022-12-14_08:20:40.765810) 08:20:43.909837 run osmo-hlr_10.42.42.2(pid=27738): stderr: | 20221214082040960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082040960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082040960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082040960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082040960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082040961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082040972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082040981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082040982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082040982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:20:43.981777 run osmo-msc_10.42.42.6(pid=27744): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27744)] 08:20:44.031073 run osmo-msc_10.42.42.6(pid=27744): stdout: | (launched: 2022-12-14_08:20:42.822896) 08:20:44.082217 run osmo-msc_10.42.42.6(pid=27744): stderr: | 20221214082043139 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082043139 DLGLOBAL DEBUG validating counter group 0x7fbdc5e3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082043140 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082043140 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082043140 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082043140 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082043142 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082043142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082043142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082043142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:20:44.134022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27737): Terminating (SIGTERM) 08:20:44.175560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27740): Terminating (SIGTERM) 08:20:44.217013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27743): Terminating (SIGTERM) 08:20:44.258775 --- ParallelTerminationStrategy: PID 27737 died... 08:20:44.278900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27737): Terminated: ok {rc=0} 08:20:44.324868 --- ParallelTerminationStrategy: PID 27740 died... 08:20:44.344622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27740): Terminated: ok {rc=0} 08:20:44.390464 --- ParallelTerminationStrategy: PID 27743 died... 08:20:44.410135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27743): Terminated: ok {rc=0} 08:20:44.498281 bus /sierra_3: Setting Powered False 08:20:45.595541 bus /sierra_3: Setting Powered False 08:20:46.715038 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 08:20:47.992165 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:20:47.999168 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:20:48.059819 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:20:48.086957 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:20:48.139661 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:20:48.199257 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:20:48.226514 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:20:48.779822 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 08:20:48.785617 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:48.797294 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:20:48.843168 tst handover.py: using LAC 39643 08:20:48.975055 tst handover.py: using RAC 118 08:20:49.104670 tst handover.py: using CellId 39643 08:20:49.233352 tst handover.py: using BVCI 39644 08:20:49.354535 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:20:49.403595 tst handover.py: using LAC 39644 08:20:49.524074 tst handover.py: using RAC 119 08:20:49.644133 tst handover.py: using CellId 39644 08:20:49.766159 tst handover.py: using BVCI 39645 08:20:49.880153 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:49.891265 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:49.902096 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:49.913081 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:49.923886 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:20:49.934720 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:20:50.054398 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:20:50.172716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:20:50.623135 run create_hlr_db(pid=27749): Launched 08:20:50.749485 bus /sierra_2: Setting Powered False 08:20:51.810926 run create_hlr_db(pid=27749): Terminated: ok {rc=0} 08:20:52.233874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27755): Launched 08:20:52.563933 run osmo-hlr_10.42.42.2(pid=27756): Launched 08:20:52.690544 run osmo-stp_10.42.42.5: Starting osmo-stp 08:20:53.236185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27758): Launched 08:20:53.566079 run osmo-stp_10.42.42.5(pid=27759): Launched 08:20:53.692333 run osmo-msc_10.42.42.6: Starting osmo-msc 08:20:54.258575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27761): Launched 08:20:54.588096 run osmo-msc_10.42.42.6(pid=27762): Launched 08:20:54.772055 run osmo-stp_10.42.42.5(pid=27759): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27759)] 08:20:54.910728 run osmo-stp_10.42.42.5(pid=27759): stdout: | (launched: 2022-12-14_08:20:53.505797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:55.049423 run osmo-stp_10.42.42.5(pid=27759): stderr: | 20221214082053695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082053695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082053695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082053696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082053696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082053696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082053696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:55.185847 run osmo-stp_10.42.42.5(pid=27759): stdout: | (launched: 2022-12-14_08:20:53.505797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:20:55.316140 run osmo-stp_10.42.42.5(pid=27759): stderr: | 20221214082053695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082053695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082053695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082053696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082053696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082053696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082053696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:20:55.472855 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27759): Process ended prematurely: osmo-stp_10.42.42.5(pid=27759) [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27759)] [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 08:20:55.481583 tst handover.py:18: Test FAILED (6.7 sec) 08:20:55.508921 run osmo-hlr_10.42.42.2(pid=27756): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27756)] 08:20:55.559339 run osmo-hlr_10.42.42.2(pid=27756): stdout: | (launched: 2022-12-14_08:20:52.503958) 08:20:55.611114 run osmo-hlr_10.42.42.2(pid=27756): stderr: | 20221214082052698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082052698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082052698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082052699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082052699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082052699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082052711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082052719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082052719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082052719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:20:55.683273 run osmo-msc_10.42.42.6(pid=27762): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27762)] 08:20:55.732752 run osmo-msc_10.42.42.6(pid=27762): stdout: | (launched: 2022-12-14_08:20:54.527926) 08:20:55.784300 run osmo-msc_10.42.42.6(pid=27762): stderr: | 20221214082054844 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082054844 DLGLOBAL DEBUG validating counter group 0x7f21006fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082054844 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082054844 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082054844 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082054845 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082054846 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082054847 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082054847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082054847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:20:55.836230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27755): Terminating (SIGTERM) 08:20:55.877448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27758): Terminating (SIGTERM) 08:20:55.919588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27761): Terminating (SIGTERM) 08:20:55.962145 --- ParallelTerminationStrategy: PID 27755 died... 08:20:55.982360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27755): Terminated: ok {rc=0} 08:20:56.028446 --- ParallelTerminationStrategy: PID 27758 died... 08:20:56.048156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27758): Terminated: ok {rc=0} 08:20:56.093855 --- ParallelTerminationStrategy: PID 27761 died... 08:20:56.113562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27761): Terminated: ok {rc=0} 08:20:56.202144 bus /sierra_3: Setting Powered False 08:20:57.301052 bus /sierra_3: Setting Powered False 08:20:58.417762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 08:20:59.688493 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:20:59.694337 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:20:59.747656 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:20:59.774901 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:20:59.828254 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:20:59.880383 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:20:59.907810 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:21:00.459353 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 08:21:00.465288 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:21:00.476752 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 08:21:00.529677 tst handover.py: using LAC 39645 08:21:00.651483 tst handover.py: using RAC 120 08:21:00.772478 tst handover.py: using CellId 39645 08:21:00.918883 tst handover.py: using BVCI 39646 08:21:01.038760 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 08:21:01.073579 tst handover.py: using LAC 39646 08:21:01.206912 tst handover.py: using RAC 121 08:21:01.351102 tst handover.py: using CellId 39646 08:21:01.486390 tst handover.py: using BVCI 39647 08:21:01.600638 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:21:01.612480 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:21:01.623906 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:21:01.635285 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:21:01.646800 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:21:01.658446 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 08:21:01.801941 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 08:21:01.947935 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:21:02.441851 run create_hlr_db(pid=27767): Launched 08:21:02.570504 bus /sierra_2: Setting Powered False 08:21:03.635363 run create_hlr_db(pid=27767): Terminated: ok {rc=0} 08:21:04.066654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27769): Launched 08:21:04.397782 run osmo-hlr_10.42.42.2(pid=27770): Launched 08:21:04.524221 run osmo-stp_10.42.42.5: Starting osmo-stp 08:21:05.062109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27772): Launched 08:21:05.376077 run osmo-stp_10.42.42.5(pid=27773): Launched 08:21:05.493421 run osmo-msc_10.42.42.6: Starting osmo-msc 08:21:06.022655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27775): Launched 08:21:06.331855 run osmo-msc_10.42.42.6(pid=27776): Launched 08:21:06.504677 run osmo-stp_10.42.42.5(pid=27773): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27773)] 08:21:06.635056 run osmo-stp_10.42.42.5(pid=27773): stdout: | (launched: 2022-12-14_08:21:05.318234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:06.765311 run osmo-stp_10.42.42.5(pid=27773): stderr: | 20221214082105485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082105485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082105485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082105486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082105486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082105486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082105486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:06.893220 run osmo-stp_10.42.42.5(pid=27773): stdout: | (launched: 2022-12-14_08:21:05.318234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:07.015718 run osmo-stp_10.42.42.5(pid=27773): stderr: | 20221214082105485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082105485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082105485 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082105486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082105486 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082105486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082105486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:07.162560 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27773): Process ended prematurely: osmo-stp_10.42.42.5(pid=27773) [trial-2401↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27773)] [trial-2401↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 08:21:07.171128 tst handover.py:18: Test FAILED (6.7 sec) 08:21:07.197428 run osmo-hlr_10.42.42.2(pid=27770): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27770)] 08:21:07.245469 run osmo-hlr_10.42.42.2(pid=27770): stdout: | (launched: 2022-12-14_08:21:04.337316) 08:21:07.294963 run osmo-hlr_10.42.42.2(pid=27770): stderr: | 20221214082104530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082104530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082104530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082104530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082104530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082104531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082104543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082104551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082104551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082104551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:21:07.363277 run osmo-msc_10.42.42.6(pid=27776): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27776)] 08:21:07.410211 run osmo-msc_10.42.42.6(pid=27776): stdout: | (launched: 2022-12-14_08:21:06.274597) 08:21:07.459077 run osmo-msc_10.42.42.6(pid=27776): stderr: | 20221214082106545 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082106546 DLGLOBAL DEBUG validating counter group 0x7f6e640bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082106546 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082106546 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082106546 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082106546 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082106548 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082106548 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082106548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082106548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:21:07.508565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27769): Terminating (SIGTERM) 08:21:07.548389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27772): Terminating (SIGTERM) 08:21:07.588219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27775): Terminating (SIGTERM) 08:21:07.628411 --- ParallelTerminationStrategy: PID 27769 died... 08:21:07.647853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27769): Terminated: ok {rc=0} 08:21:07.692006 --- ParallelTerminationStrategy: PID 27772 died... 08:21:07.710927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27772): Terminated: ok {rc=0} 08:21:07.755057 --- ParallelTerminationStrategy: PID 27775 died... 08:21:07.774070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27775): Terminated: ok {rc=0} 08:21:07.859648 bus /sierra_3: Setting Powered False 08:21:08.959852 bus /sierra_3: Setting Powered False 08:21:10.074281 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 08:21:11.330864 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:21:11.336184 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:21:11.399288 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:21:11.426045 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:21:11.479384 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:21:11.545425 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:21:11.571602 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:21:12.123097 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 08:21:12.129610 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:12.141417 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:21:12.191701 tst handover.py: using LAC 39647 08:21:12.323530 tst handover.py: using RAC 122 08:21:12.452077 tst handover.py: using CellId 39647 08:21:12.582461 tst handover.py: using BVCI 39648 08:21:12.702457 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:21:12.765444 tst handover.py: using LAC 39648 08:21:12.890847 tst handover.py: using RAC 123 08:21:13.012352 tst handover.py: using CellId 39648 08:21:13.134049 tst handover.py: using BVCI 39649 08:21:13.246429 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:13.257598 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:13.268549 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:13.279636 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:13.290666 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:13.301682 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:21:13.417301 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:21:13.536558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:21:14.019211 run create_hlr_db(pid=27781): Launched 08:21:14.145740 bus /sierra_2: Setting Powered False 08:21:15.210816 run create_hlr_db(pid=27781): Terminated: ok {rc=0} 08:21:15.641118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27783): Launched 08:21:15.997714 run osmo-hlr_10.42.42.2(pid=27784): Launched 08:21:16.255849 run osmo-stp_10.42.42.5: Starting osmo-stp 08:21:16.851322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27786): Launched 08:21:17.202484 run osmo-stp_10.42.42.5(pid=27787): Launched 08:21:17.338782 run osmo-msc_10.42.42.6: Starting osmo-msc 08:21:17.907639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27789): Launched 08:21:18.238234 run osmo-msc_10.42.42.6(pid=27790): Launched 08:21:18.422129 run osmo-stp_10.42.42.5(pid=27787): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27787)] 08:21:18.560508 run osmo-stp_10.42.42.5(pid=27787): stdout: | (launched: 2022-12-14_08:21:17.137722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:18.699482 run osmo-stp_10.42.42.5(pid=27787): stderr: | 20221214082117355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082117355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082117355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082117356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082117356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082117356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082117356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:18.836450 run osmo-stp_10.42.42.5(pid=27787): stdout: | (launched: 2022-12-14_08:21:17.137722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:18.967585 run osmo-stp_10.42.42.5(pid=27787): stderr: | 20221214082117355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082117355 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082117355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082117356 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082117356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082117356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082117356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:19.124778 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27787): Process ended prematurely: osmo-stp_10.42.42.5(pid=27787) [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27787)] [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 08:21:19.133719 tst handover.py:18: Test FAILED (7.0 sec) 08:21:19.161132 run osmo-hlr_10.42.42.2(pid=27784): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27784)] 08:21:19.211814 run osmo-hlr_10.42.42.2(pid=27784): stdout: | (launched: 2022-12-14_08:21:15.927821) 08:21:19.263752 run osmo-hlr_10.42.42.2(pid=27784): stderr: | 20221214082116178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082116178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082116178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082116178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082116178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082116178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082116215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082116232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082116232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082116232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:21:19.336178 run osmo-msc_10.42.42.6(pid=27790): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27790)] 08:21:19.385678 run osmo-msc_10.42.42.6(pid=27790): stdout: | (launched: 2022-12-14_08:21:18.177917) 08:21:19.437206 run osmo-msc_10.42.42.6(pid=27790): stderr: | 20221214082118494 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082118494 DLGLOBAL DEBUG validating counter group 0x7f11a7865c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082118494 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082118495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082118495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082118495 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082118497 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082118498 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082118498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082118498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:21:19.489334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27783): Terminating (SIGTERM) 08:21:19.531308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27786): Terminating (SIGTERM) 08:21:19.573404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27789): Terminating (SIGTERM) 08:21:19.615591 --- ParallelTerminationStrategy: PID 27783 died... 08:21:19.636016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27783): Terminated: ok {rc=0} 08:21:19.682320 --- ParallelTerminationStrategy: PID 27786 died... 08:21:19.702308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27786): Terminated: ok {rc=0} 08:21:19.748536 --- ParallelTerminationStrategy: PID 27789 died... 08:21:19.768482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27789): Terminated: ok {rc=0} 08:21:19.855747 bus /sierra_3: Setting Powered False 08:21:20.953547 bus /sierra_3: Setting Powered False 08:21:22.068549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 08:21:23.338045 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:21:23.343235 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:21:23.405846 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:21:23.432206 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:21:23.483068 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:21:23.545458 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:21:23.571573 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:21:24.123966 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 08:21:24.129131 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:24.140542 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:21:24.191213 tst handover.py: using LAC 39649 08:21:24.311413 tst handover.py: using RAC 124 08:21:24.431074 tst handover.py: using CellId 39649 08:21:24.552887 tst handover.py: using BVCI 39650 08:21:24.664712 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:21:24.710942 tst handover.py: using LAC 39650 08:21:24.831737 tst handover.py: using RAC 125 08:21:24.962330 tst handover.py: using CellId 39650 08:21:25.092489 tst handover.py: using BVCI 39651 08:21:25.214098 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:25.225849 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:25.237408 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:25.248820 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:25.260733 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:25.272880 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:21:25.391706 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:21:25.512186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:21:25.995618 run create_hlr_db(pid=27795): Launched 08:21:26.122231 bus /sierra_2: Setting Powered False 08:21:27.186996 run create_hlr_db(pid=27795): Terminated: ok {rc=0} 08:21:27.599598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27797): Launched 08:21:27.907154 run osmo-hlr_10.42.42.2(pid=27798): Launched 08:21:28.023741 run osmo-stp_10.42.42.5: Starting osmo-stp 08:21:28.525017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27800): Launched 08:21:28.832010 run osmo-stp_10.42.42.5(pid=27801): Launched 08:21:28.949188 run osmo-msc_10.42.42.6: Starting osmo-msc 08:21:29.478972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27803): Launched 08:21:29.787232 run osmo-msc_10.42.42.6(pid=27804): Launched 08:21:29.958449 run osmo-stp_10.42.42.5(pid=27801): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27801)] 08:21:30.087075 run osmo-stp_10.42.42.5(pid=27801): stdout: | (launched: 2022-12-14_08:21:28.775261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:30.215863 run osmo-stp_10.42.42.5(pid=27801): stderr: | 20221214082128943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082128943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082128943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082128944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082128944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082128944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082128944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:30.343029 run osmo-stp_10.42.42.5(pid=27801): stdout: | (launched: 2022-12-14_08:21:28.775261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:30.464160 run osmo-stp_10.42.42.5(pid=27801): stderr: | 20221214082128943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082128943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082128943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082128944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082128944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082128944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082128944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:30.611044 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27801): Process ended prematurely: osmo-stp_10.42.42.5(pid=27801) [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27801)] [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 08:21:30.619374 tst handover.py:18: Test FAILED (6.5 sec) 08:21:30.645377 run osmo-hlr_10.42.42.2(pid=27798): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27798)] 08:21:30.693156 run osmo-hlr_10.42.42.2(pid=27798): stdout: | (launched: 2022-12-14_08:21:27.850718) 08:21:30.742270 run osmo-hlr_10.42.42.2(pid=27798): stderr: | 20221214082128023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082128023 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082128023 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082128023 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082128023 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082128023 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082128036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082128045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082128046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082128046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:21:30.810847 run osmo-msc_10.42.42.6(pid=27804): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27804)] 08:21:30.868344 run osmo-msc_10.42.42.6(pid=27804): stdout: | (launched: 2022-12-14_08:21:29.730763) 08:21:30.932353 run osmo-msc_10.42.42.6(pid=27804): stderr: | 20221214082129999 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082129999 DLGLOBAL DEBUG validating counter group 0x7fd583b05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082129999 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082129999 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082129999 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082129999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082130001 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082130001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082130002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082130002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:21:30.982649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27797): Terminating (SIGTERM) 08:21:31.031631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27800): Terminating (SIGTERM) 08:21:31.078223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27803): Terminating (SIGTERM) 08:21:31.125359 --- ParallelTerminationStrategy: PID 27797 died... 08:21:31.147629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27797): Terminated: ok {rc=0} 08:21:31.203548 --- ParallelTerminationStrategy: PID 27800 died... 08:21:31.224210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27800): Terminated: ok {rc=0} 08:21:31.273434 --- ParallelTerminationStrategy: PID 27803 died... 08:21:31.295077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27803): Terminated: ok {rc=0} 08:21:31.388575 bus /sierra_3: Setting Powered False 08:21:32.488454 bus /sierra_3: Setting Powered False 08:21:33.605007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 08:21:34.878234 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:21:34.884515 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:21:34.935128 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:21:34.961765 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:21:35.014601 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:21:35.067408 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:21:35.094966 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:21:35.643784 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 08:21:35.649922 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:35.661379 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:21:35.696160 tst handover.py: using LAC 39651 08:21:35.817866 tst handover.py: using RAC 126 08:21:35.938253 tst handover.py: using CellId 39651 08:21:36.065571 tst handover.py: using BVCI 39652 08:21:36.178098 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:21:36.224875 tst handover.py: using LAC 39652 08:21:36.344231 tst handover.py: using RAC 127 08:21:36.463506 tst handover.py: using CellId 39652 08:21:36.582878 tst handover.py: using BVCI 39653 08:21:36.693932 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:36.704731 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:36.715404 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:36.725984 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:36.737260 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:21:36.748345 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:21:36.866052 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:21:36.987342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:21:37.471037 run create_hlr_db(pid=27809): Launched 08:21:37.598411 bus /sierra_2: Setting Powered False 08:21:38.663491 run create_hlr_db(pid=27809): Terminated: ok {rc=0} 08:21:39.095082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27811): Launched 08:21:39.426830 run osmo-hlr_10.42.42.2(pid=27812): Launched 08:21:39.554984 run osmo-stp_10.42.42.5: Starting osmo-stp 08:21:40.098570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27814): Launched 08:21:40.431453 run osmo-stp_10.42.42.5(pid=27815): Launched 08:21:40.557717 run osmo-msc_10.42.42.6: Starting osmo-msc 08:21:41.124434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27817): Launched 08:21:41.455005 run osmo-msc_10.42.42.6(pid=27818): Launched 08:21:41.639582 run osmo-stp_10.42.42.5(pid=27815): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27815)] 08:21:41.778043 run osmo-stp_10.42.42.5(pid=27815): stdout: | (launched: 2022-12-14_08:21:40.371267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:41.917564 run osmo-stp_10.42.42.5(pid=27815): stderr: | 20221214082140559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082140559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082140559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082140560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082140560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082140560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082140561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:42.055838 run osmo-stp_10.42.42.5(pid=27815): stdout: | (launched: 2022-12-14_08:21:40.371267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:42.186634 run osmo-stp_10.42.42.5(pid=27815): stderr: | 20221214082140559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082140559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082140559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082140560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082140560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082140560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082140561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:42.343569 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27815): Process ended prematurely: osmo-stp_10.42.42.5(pid=27815) [trial-2401↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27815)] [trial-2401↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 08:21:42.352378 tst handover.py:18: Test FAILED (6.7 sec) 08:21:42.379716 run osmo-hlr_10.42.42.2(pid=27812): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27812)] 08:21:42.430401 run osmo-hlr_10.42.42.2(pid=27812): stdout: | (launched: 2022-12-14_08:21:39.366245) 08:21:42.482667 run osmo-hlr_10.42.42.2(pid=27812): stderr: | 20221214082139560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082139560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082139561 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082139561 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082139561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082139561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082139573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082139581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082139581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082139581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:21:42.555071 run osmo-msc_10.42.42.6(pid=27818): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27818)] 08:21:42.605754 run osmo-msc_10.42.42.6(pid=27818): stdout: | (launched: 2022-12-14_08:21:41.394791) 08:21:42.657491 run osmo-msc_10.42.42.6(pid=27818): stderr: | 20221214082141712 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082141712 DLGLOBAL DEBUG validating counter group 0x7f2a712abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082141712 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082141712 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082141712 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082141712 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082141714 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082141714 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082141715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082141715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:21:42.710008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27811): Terminating (SIGTERM) 08:21:42.751834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27814): Terminating (SIGTERM) 08:21:42.793958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27817): Terminating (SIGTERM) 08:21:42.836347 --- ParallelTerminationStrategy: PID 27811 died... 08:21:42.856691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27811): Terminated: ok {rc=0} 08:21:42.903154 --- ParallelTerminationStrategy: PID 27814 died... 08:21:42.923326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27814): Terminated: ok {rc=0} 08:21:42.969714 --- ParallelTerminationStrategy: PID 27817 died... 08:21:42.989624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27817): Terminated: ok {rc=0} 08:21:43.077250 bus /sierra_3: Setting Powered False 08:21:44.175802 bus /sierra_3: Setting Powered False 08:21:45.291719 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 08:21:46.571302 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:21:46.580202 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:21:46.637855 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:21:46.666800 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:21:46.722499 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:21:46.776697 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:21:46.806593 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:21:47.348412 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 08:21:47.354661 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:47.366161 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:21:47.402880 tst handover.py: using LAC 39653 08:21:47.532273 tst handover.py: using RAC 128 08:21:47.653323 tst handover.py: using CellId 39653 08:21:47.776297 tst handover.py: using BVCI 39654 08:21:47.889081 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:21:47.934983 tst handover.py: using LAC 39654 08:21:48.054077 tst handover.py: using RAC 129 08:21:48.173172 tst handover.py: using CellId 39654 08:21:48.291768 tst handover.py: using BVCI 39655 08:21:48.403672 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:48.414711 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:48.425566 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:48.436329 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:48.447482 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:48.458286 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:21:48.579925 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:21:48.696887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:21:49.147376 run create_hlr_db(pid=27823): Launched 08:21:49.273230 bus /sierra_2: Setting Powered False 08:21:50.335203 run create_hlr_db(pid=27823): Terminated: ok {rc=0} 08:21:50.738099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27825): Launched 08:21:51.046345 run osmo-hlr_10.42.42.2(pid=27826): Launched 08:21:51.162721 run osmo-stp_10.42.42.5: Starting osmo-stp 08:21:51.676386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27828): Launched 08:21:51.984142 run osmo-stp_10.42.42.5(pid=27829): Launched 08:21:52.101925 run osmo-msc_10.42.42.6: Starting osmo-msc 08:21:52.630622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27831): Launched 08:21:52.939370 run osmo-msc_10.42.42.6(pid=27832): Launched 08:21:53.115260 run osmo-stp_10.42.42.5(pid=27829): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27829)] 08:21:53.249943 run osmo-stp_10.42.42.5(pid=27829): stdout: | (launched: 2022-12-14_08:21:51.927571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:53.379399 run osmo-stp_10.42.42.5(pid=27829): stderr: | 20221214082152096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082152096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082152096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082152097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082152097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082152097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082152097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:53.506675 run osmo-stp_10.42.42.5(pid=27829): stdout: | (launched: 2022-12-14_08:21:51.927571) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:21:53.628368 run osmo-stp_10.42.42.5(pid=27829): stderr: | 20221214082152096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082152096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082152096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082152097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082152097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082152097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082152097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:21:53.774174 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27829): Process ended prematurely: osmo-stp_10.42.42.5(pid=27829) [trial-2401↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27829)] [trial-2401↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 08:21:53.782473 tst handover.py:18: Test FAILED (6.4 sec) 08:21:53.808671 run osmo-hlr_10.42.42.2(pid=27826): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27826)] 08:21:53.856824 run osmo-hlr_10.42.42.2(pid=27826): stdout: | (launched: 2022-12-14_08:21:50.989422) 08:21:53.906273 run osmo-hlr_10.42.42.2(pid=27826): stderr: | 20221214082151162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082151162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082151162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082151162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082151162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082151162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082151174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082151183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082151183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082151183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:21:53.975454 run osmo-msc_10.42.42.6(pid=27832): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27832)] 08:21:54.022775 run osmo-msc_10.42.42.6(pid=27832): stdout: | (launched: 2022-12-14_08:21:52.882673) 08:21:54.071986 run osmo-msc_10.42.42.6(pid=27832): stderr: | 20221214082153151 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082153151 DLGLOBAL DEBUG validating counter group 0x7fd0e4d0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082153151 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082153151 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082153151 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082153152 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082153153 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082153154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082153154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082153154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:21:54.121944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27825): Terminating (SIGTERM) 08:21:54.162150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27828): Terminating (SIGTERM) 08:21:54.202097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27831): Terminating (SIGTERM) 08:21:54.242508 --- ParallelTerminationStrategy: PID 27825 died... 08:21:54.261820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27825): Terminated: ok {rc=0} 08:21:54.306008 --- ParallelTerminationStrategy: PID 27828 died... 08:21:54.324838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27828): Terminated: ok {rc=0} 08:21:54.368899 --- ParallelTerminationStrategy: PID 27831 died... 08:21:54.387816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27831): Terminated: ok {rc=0} 08:21:54.473529 bus /sierra_3: Setting Powered False 08:21:55.572486 bus /sierra_3: Setting Powered False 08:21:56.688641 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2401 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 08:21:57.947845 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:21:57.953744 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:21:58.019565 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:21:58.047000 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:21:58.101031 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:21:58.165462 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:21:58.192538 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:21:58.743077 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2401 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 08:21:58.748869 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:58.760431 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:21:58.811143 tst handover.py: using LAC 39655 08:21:58.940847 tst handover.py: using RAC 130 08:21:59.071633 tst handover.py: using CellId 39655 08:21:59.202463 tst handover.py: using BVCI 39656 08:21:59.322287 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:21:59.371328 tst handover.py: using LAC 39656 08:21:59.501547 tst handover.py: using RAC 131 08:21:59.631050 tst handover.py: using CellId 39656 08:21:59.760290 tst handover.py: using BVCI 39657 08:21:59.879998 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:59.891502 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:59.902968 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:59.914395 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:59.925762 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:21:59.937836 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:22:00.055029 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:22:00.178338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:22:00.661731 run create_hlr_db(pid=27838): Launched 08:22:00.789607 bus /sierra_2: Setting Powered False 08:22:01.850142 run create_hlr_db(pid=27838): Terminated: ok {rc=0} 08:22:02.264429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27840): Launched 08:22:02.573541 run osmo-hlr_10.42.42.2(pid=27841): Launched 08:22:02.691603 run osmo-stp_10.42.42.5: Starting osmo-stp 08:22:03.198667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27843): Launched 08:22:03.507381 run osmo-stp_10.42.42.5(pid=27844): Launched 08:22:03.624633 run osmo-msc_10.42.42.6: Starting osmo-msc 08:22:04.154278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27846): Launched 08:22:04.463826 run osmo-msc_10.42.42.6(pid=27847): Launched 08:22:04.636345 run osmo-stp_10.42.42.5(pid=27844): ERR: Terminated: ERROR {rc=1} [trial-2401↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27844)] 08:22:04.766887 run osmo-stp_10.42.42.5(pid=27844): stdout: | (launched: 2022-12-14_08:22:03.450392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:22:04.896107 run osmo-stp_10.42.42.5(pid=27844): stderr: | 20221214082203619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082203619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082203620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082203620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082203621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082203621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082203621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:22:05.023266 run osmo-stp_10.42.42.5(pid=27844): stdout: | (launched: 2022-12-14_08:22:03.450392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:22:05.145940 run osmo-stp_10.42.42.5(pid=27844): stderr: | 20221214082203619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214082203619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214082203620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214082203620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214082203621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214082203621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214082203621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:22:05.291978 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=27844): Process ended prematurely: osmo-stp_10.42.42.5(pid=27844) [trial-2401↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27844)] [trial-2401↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 08:22:05.300064 tst handover.py:18: Test FAILED (6.5 sec) 08:22:05.326112 run osmo-hlr_10.42.42.2(pid=27841): ERR: Terminated: ERROR {rc=237} [trial-2401↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27841)] 08:22:05.373704 run osmo-hlr_10.42.42.2(pid=27841): stdout: | (launched: 2022-12-14_08:22:02.517181) 08:22:05.422927 run osmo-hlr_10.42.42.2(pid=27841): stderr: | 20221214082202690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214082202690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214082202690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214082202690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214082202690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214082202690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214082202702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214082202710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214082202711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214082202711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:22:05.491660 run osmo-msc_10.42.42.6(pid=27847): ERR: Terminated: ERROR {rc=2} [trial-2401↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27847)] 08:22:05.539460 run osmo-msc_10.42.42.6(pid=27847): stdout: | (launched: 2022-12-14_08:22:04.406811) 08:22:05.588417 run osmo-msc_10.42.42.6(pid=27847): stderr: | 20221214082204677 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214082204677 DLGLOBAL DEBUG validating counter group 0x7f5cd639dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214082204677 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214082204677 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214082204677 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214082204677 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214082204679 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214082204679 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214082204679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214082204680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:22:05.637718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27840): Terminating (SIGTERM) 08:22:05.678089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27843): Terminating (SIGTERM) 08:22:05.717455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27846): Terminating (SIGTERM) 08:22:05.757031 --- ParallelTerminationStrategy: PID 27840 died... 08:22:05.776000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27840): Terminated: ok {rc=0} 08:22:05.819660 --- ParallelTerminationStrategy: PID 27843 died... 08:22:05.838216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27843): Terminated: ok {rc=0} 08:22:05.881584 --- ParallelTerminationStrategy: PID 27846 died... 08:22:05.900115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27846): Terminated: ok {rc=0} 08:22:05.984394 bus /sierra_3: Setting Powered False 08:22:07.082028 bus /sierra_3: Setting Powered False 08:22:08.195047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2401 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 08:22:09.468402 tst trial-2401: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401/run.2022-12-14_06-57-06/trial-2401.xml -------------------------------------------------------------------------------------------- trial-2401 FAIL -------------------------------------------------------------------------------------------- 08:22:11.401881 tst trial-2401: trial-2401: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=20173): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20173) [trial-2401↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20173)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.5 sec) Error: osmo-stp_10.42.42.5(pid=20183): Process ended prematurely: osmo-stp_10.42.42.5(pid=20183) [trial-2401↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20183)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20192): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20192) [trial-2401↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20192)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20202): Process ended prematurely: osmo-stp_10.42.42.5(pid=20202) [trial-2401↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20202)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20217): Process ended prematurely: osmo-stp_10.42.42.5(pid=20217) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20217)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20231): Process ended prematurely: osmo-stp_10.42.42.5(pid=20231) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20231)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20247): Process ended prematurely: osmo-stp_10.42.42.5(pid=20247) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20247)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20258): Process ended prematurely: osmo-stp_10.42.42.5(pid=20258) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20258)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=20272): Process ended prematurely: osmo-stp_10.42.42.5(pid=20272) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20272)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20286): Process ended prematurely: osmo-stp_10.42.42.5(pid=20286) [trial-2401↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20286)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=20300): Process ended prematurely: osmo-stp_10.42.42.5(pid=20300) [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20300)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20311): Process ended prematurely: osmo-stp_10.42.42.5(pid=20311) [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20311)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20325): Process ended prematurely: osmo-stp_10.42.42.5(pid=20325) [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20325)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20336): Process ended prematurely: osmo-stp_10.42.42.5(pid=20336) [trial-2401↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20336)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20350): Process ended prematurely: osmo-stp_10.42.42.5(pid=20350) [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20350)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20361): Process ended prematurely: osmo-stp_10.42.42.5(pid=20361) [trial-2401↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20361)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=20375): Process ended prematurely: osmo-stp_10.42.42.5(pid=20375) [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20375)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20386): Process ended prematurely: osmo-stp_10.42.42.5(pid=20386) [trial-2401↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20386)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20401): Process ended prematurely: osmo-stp_10.42.42.5(pid=20401) [trial-2401↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20401)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20412): Process ended prematurely: osmo-stp_10.42.42.5(pid=20412) [trial-2401↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20412)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=20432): Process ended prematurely: osmo-stp_10.42.42.5(pid=20432) [trial-2401↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20432)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=20444): Process ended prematurely: osmo-stp_10.42.42.5(pid=20444) [trial-2401↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20444)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20462): Process ended prematurely: osmo-stp_10.42.42.5(pid=20462) [trial-2401↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20462)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20472): Process ended prematurely: osmo-stp_10.42.42.5(pid=20472) [trial-2401↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20472)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20482): Process ended prematurely: osmo-stp_10.42.42.5(pid=20482) [trial-2401↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20482)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=20501): Process ended prematurely: osmo-stp_10.42.42.5(pid=20501) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20501)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20513): Process ended prematurely: osmo-stp_10.42.42.5(pid=20513) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20513)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20531): Process ended prematurely: osmo-stp_10.42.42.5(pid=20531) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20531)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=20541): Process ended prematurely: osmo-stp_10.42.42.5(pid=20541) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20541)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20551): Process ended prematurely: osmo-stp_10.42.42.5(pid=20551) [trial-2401↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20551)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=20571): Process ended prematurely: osmo-stp_10.42.42.5(pid=20571) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20571)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20583): Process ended prematurely: osmo-stp_10.42.42.5(pid=20583) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20583)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20602): Process ended prematurely: osmo-stp_10.42.42.5(pid=20602) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20602)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20612): Process ended prematurely: osmo-stp_10.42.42.5(pid=20612) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20612)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20626): Process ended prematurely: osmo-stp_10.42.42.5(pid=20626) [trial-2401↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20626)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=20643): Process ended prematurely: osmo-stp_10.42.42.5(pid=20643) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20643)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=20655): Process ended prematurely: osmo-stp_10.42.42.5(pid=20655) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20655)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=20673): Process ended prematurely: osmo-stp_10.42.42.5(pid=20673) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20673)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=20683): Process ended prematurely: osmo-stp_10.42.42.5(pid=20683) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20683)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=20693): Process ended prematurely: osmo-stp_10.42.42.5(pid=20693) [trial-2401↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20693)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=20706): Process ended prematurely: osmo-stp_10.42.42.5(pid=20706) [trial-2401↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20706)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20720): Process ended prematurely: osmo-stp_10.42.42.5(pid=20720) [trial-2401↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20720)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=20728): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20728) [trial-2401↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20728)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=20738): Process ended prematurely: osmo-stp_10.42.42.5(pid=20738) [trial-2401↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20738)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=20747): Process ended prematurely: osmo-nitb_10.42.42.2(pid=20747) [trial-2401↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=20747)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=20757): Process ended prematurely: osmo-stp_10.42.42.5(pid=20757) [trial-2401↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20757)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20771): Process ended prematurely: osmo-stp_10.42.42.5(pid=20771) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20771)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20782): Process ended prematurely: osmo-stp_10.42.42.5(pid=20782) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20782)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=20796): Process ended prematurely: osmo-stp_10.42.42.5(pid=20796) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20796)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=20807): Process ended prematurely: osmo-stp_10.42.42.5(pid=20807) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20807)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20821): Process ended prematurely: osmo-stp_10.42.42.5(pid=20821) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20821)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=20832): Process ended prematurely: osmo-stp_10.42.42.5(pid=20832) [trial-2401↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20832)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=20969): Process ended prematurely: osmo-stp_10.42.42.5(pid=20969) [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=20969)] FAIL: mo_mt_call_osmux.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=21128): Process ended prematurely: osmo-stp_10.42.42.5(pid=21128) [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21128)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21143): Process ended prematurely: osmo-stp_10.42.42.5(pid=21143) [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21143)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21154): Process ended prematurely: osmo-stp_10.42.42.5(pid=21154) [trial-2401↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21154)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21169): Process ended prematurely: osmo-stp_10.42.42.5(pid=21169) [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21169)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21180): Process ended prematurely: osmo-stp_10.42.42.5(pid=21180) [trial-2401↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21180)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21197): Process ended prematurely: osmo-stp_10.42.42.5(pid=21197) [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21197)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21208): Process ended prematurely: osmo-stp_10.42.42.5(pid=21208) [trial-2401↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21208)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21225): Process ended prematurely: osmo-stp_10.42.42.5(pid=21225) [trial-2401↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21225)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21237): Process ended prematurely: osmo-stp_10.42.42.5(pid=21237) [trial-2401↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21237)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=21255): Process ended prematurely: osmo-stp_10.42.42.5(pid=21255) [trial-2401↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21255)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21267): Process ended prematurely: osmo-stp_10.42.42.5(pid=21267) [trial-2401↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21267)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=21285): Process ended prematurely: osmo-stp_10.42.42.5(pid=21285) [trial-2401↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21285)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21295): Process ended prematurely: osmo-stp_10.42.42.5(pid=21295) [trial-2401↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21295)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21305): Process ended prematurely: osmo-stp_10.42.42.5(pid=21305) [trial-2401↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21305)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=21324): Process ended prematurely: osmo-stp_10.42.42.5(pid=21324) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21324)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=21336): Process ended prematurely: osmo-stp_10.42.42.5(pid=21336) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21336)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=21354): Process ended prematurely: osmo-stp_10.42.42.5(pid=21354) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21354)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21364): Process ended prematurely: osmo-stp_10.42.42.5(pid=21364) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21364)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21374): Process ended prematurely: osmo-stp_10.42.42.5(pid=21374) [trial-2401↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21374)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=21391): Process ended prematurely: osmo-stp_10.42.42.5(pid=21391) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21391)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21403): Process ended prematurely: osmo-stp_10.42.42.5(pid=21403) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21403)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=21421): Process ended prematurely: osmo-stp_10.42.42.5(pid=21421) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21421)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21432): Process ended prematurely: osmo-stp_10.42.42.5(pid=21432) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21432)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21442): Process ended prematurely: osmo-stp_10.42.42.5(pid=21442) [trial-2401↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21442)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21460): Process ended prematurely: osmo-stp_10.42.42.5(pid=21460) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21460)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=21472): Process ended prematurely: osmo-stp_10.42.42.5(pid=21472) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21472)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=21490): Process ended prematurely: osmo-stp_10.42.42.5(pid=21490) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21490)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21500): Process ended prematurely: osmo-stp_10.42.42.5(pid=21500) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21500)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21510): Process ended prematurely: osmo-stp_10.42.42.5(pid=21510) [trial-2401↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21510)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21527): Process ended prematurely: osmo-stp_10.42.42.5(pid=21527) [trial-2401↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21527)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21540): Process ended prematurely: osmo-stp_10.42.42.5(pid=21540) [trial-2401↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21540)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21548): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21548) [trial-2401↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21548)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21558): Process ended prematurely: osmo-stp_10.42.42.5(pid=21558) [trial-2401↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21558)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=21567): Process ended prematurely: osmo-nitb_10.42.42.2(pid=21567) [trial-2401↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=21567)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21578): Process ended prematurely: osmo-stp_10.42.42.5(pid=21578) [trial-2401↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21578)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21592): Process ended prematurely: osmo-stp_10.42.42.5(pid=21592) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21592)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21603): Process ended prematurely: osmo-stp_10.42.42.5(pid=21603) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21603)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21617): Process ended prematurely: osmo-stp_10.42.42.5(pid=21617) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21617)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21628): Process ended prematurely: osmo-stp_10.42.42.5(pid=21628) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21628)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21642): Process ended prematurely: osmo-stp_10.42.42.5(pid=21642) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21642)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21653): Process ended prematurely: osmo-stp_10.42.42.5(pid=21653) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21653)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21670): Process ended prematurely: osmo-stp_10.42.42.5(pid=21670) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21670)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21681): Process ended prematurely: osmo-stp_10.42.42.5(pid=21681) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21681)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=21695): Process ended prematurely: osmo-stp_10.42.42.5(pid=21695) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21695)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21706): Process ended prematurely: osmo-stp_10.42.42.5(pid=21706) [trial-2401↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21706)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21726): Process ended prematurely: osmo-stp_10.42.42.5(pid=21726) [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21726)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21737): Process ended prematurely: osmo-stp_10.42.42.5(pid=21737) [trial-2401↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21737)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21751): Process ended prematurely: osmo-stp_10.42.42.5(pid=21751) [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21751)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=21762): Process ended prematurely: osmo-stp_10.42.42.5(pid=21762) [trial-2401↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21762)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21776): Process ended prematurely: osmo-stp_10.42.42.5(pid=21776) [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21776)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=21787): Process ended prematurely: osmo-stp_10.42.42.5(pid=21787) [trial-2401↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21787)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=21801): Process ended prematurely: osmo-stp_10.42.42.5(pid=21801) [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21801)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21812): Process ended prematurely: osmo-stp_10.42.42.5(pid=21812) [trial-2401↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21812)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=21826): Process ended prematurely: osmo-stp_10.42.42.5(pid=21826) [trial-2401↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21826)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=21837): Process ended prematurely: osmo-stp_10.42.42.5(pid=21837) [trial-2401↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21837)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21855): Process ended prematurely: osmo-stp_10.42.42.5(pid=21855) [trial-2401↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21855)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=21867): Process ended prematurely: osmo-stp_10.42.42.5(pid=21867) [trial-2401↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21867)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=21888): Process ended prematurely: osmo-stp_10.42.42.5(pid=21888) [trial-2401↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21888)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21898): Process ended prematurely: osmo-stp_10.42.42.5(pid=21898) [trial-2401↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21898)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=21908): Process ended prematurely: osmo-stp_10.42.42.5(pid=21908) [trial-2401↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21908)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=21928): Process ended prematurely: osmo-stp_10.42.42.5(pid=21928) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21928)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=21942): Process ended prematurely: osmo-stp_10.42.42.5(pid=21942) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21942)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=21961): Process ended prematurely: osmo-stp_10.42.42.5(pid=21961) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21961)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=21971): Process ended prematurely: osmo-stp_10.42.42.5(pid=21971) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21971)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=21981): Process ended prematurely: osmo-stp_10.42.42.5(pid=21981) [trial-2401↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21981)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=21999): Process ended prematurely: osmo-stp_10.42.42.5(pid=21999) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21999)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22011): Process ended prematurely: osmo-stp_10.42.42.5(pid=22011) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22011)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=22029): Process ended prematurely: osmo-stp_10.42.42.5(pid=22029) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22029)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22039): Process ended prematurely: osmo-stp_10.42.42.5(pid=22039) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22039)] FAIL: ping_idle_ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=22049): Process ended prematurely: osmo-stp_10.42.42.5(pid=22049) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22049)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=22066): Process ended prematurely: osmo-stp_10.42.42.5(pid=22066) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22066)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=22078): Process ended prematurely: osmo-stp_10.42.42.5(pid=22078) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22078)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=22096): Process ended prematurely: osmo-stp_10.42.42.5(pid=22096) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22096)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22106): Process ended prematurely: osmo-stp_10.42.42.5(pid=22106) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22106)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22116): Process ended prematurely: osmo-stp_10.42.42.5(pid=22116) [trial-2401↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22116)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=22134): Process ended prematurely: osmo-stp_10.42.42.5(pid=22134) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22134)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=22146): Process ended prematurely: osmo-stp_10.42.42.5(pid=22146) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22146)] FAIL: iperf3m4.py (12.4 sec) Error: osmo-stp_10.42.42.5(pid=22437): Process ended prematurely: osmo-stp_10.42.42.5(pid=22437) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22437)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=22447): Process ended prematurely: osmo-stp_10.42.42.5(pid=22447) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22447)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=22457): Process ended prematurely: osmo-stp_10.42.42.5(pid=22457) [trial-2401↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22457)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22470): Process ended prematurely: osmo-stp_10.42.42.5(pid=22470) [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22470)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22484): Process ended prematurely: osmo-stp_10.42.42.5(pid=22484) [trial-2401↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22484)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22495): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22495) [trial-2401↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22495)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22505): Process ended prematurely: osmo-stp_10.42.42.5(pid=22505) [trial-2401↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22505)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=22514): Process ended prematurely: osmo-nitb_10.42.42.2(pid=22514) [trial-2401↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=22514)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22524): Process ended prematurely: osmo-stp_10.42.42.5(pid=22524) [trial-2401↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22524)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22538): Process ended prematurely: osmo-stp_10.42.42.5(pid=22538) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22538)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22549): Process ended prematurely: osmo-stp_10.42.42.5(pid=22549) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22549)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22566): Process ended prematurely: osmo-stp_10.42.42.5(pid=22566) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22566)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22578): Process ended prematurely: osmo-stp_10.42.42.5(pid=22578) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22578)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22592): Process ended prematurely: osmo-stp_10.42.42.5(pid=22592) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22592)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22603): Process ended prematurely: osmo-stp_10.42.42.5(pid=22603) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22603)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22617): Process ended prematurely: osmo-stp_10.42.42.5(pid=22617) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22617)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22628): Process ended prematurely: osmo-stp_10.42.42.5(pid=22628) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22628)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22642): Process ended prematurely: osmo-stp_10.42.42.5(pid=22642) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22642)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22653): Process ended prematurely: osmo-stp_10.42.42.5(pid=22653) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22653)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22668): Process ended prematurely: osmo-stp_10.42.42.5(pid=22668) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22668)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=22679): Process ended prematurely: osmo-stp_10.42.42.5(pid=22679) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22679)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22694): Process ended prematurely: osmo-stp_10.42.42.5(pid=22694) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22694)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22705): Process ended prematurely: osmo-stp_10.42.42.5(pid=22705) [trial-2401↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22705)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=22719): Process ended prematurely: osmo-stp_10.42.42.5(pid=22719) [trial-2401↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22719)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22730): Process ended prematurely: osmo-stp_10.42.42.5(pid=22730) [trial-2401↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22730)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22748): Process ended prematurely: osmo-stp_10.42.42.5(pid=22748) [trial-2401↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22748)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=22760): Process ended prematurely: osmo-stp_10.42.42.5(pid=22760) [trial-2401↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22760)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=22778): Process ended prematurely: osmo-stp_10.42.42.5(pid=22778) [trial-2401↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22778)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=22788): Process ended prematurely: osmo-stp_10.42.42.5(pid=22788) [trial-2401↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22788)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22798): Process ended prematurely: osmo-stp_10.42.42.5(pid=22798) [trial-2401↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22798)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=22815): Process ended prematurely: osmo-stp_10.42.42.5(pid=22815) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22815)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22827): Process ended prematurely: osmo-stp_10.42.42.5(pid=22827) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22827)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=22848): Process ended prematurely: osmo-stp_10.42.42.5(pid=22848) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22848)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22858): Process ended prematurely: osmo-stp_10.42.42.5(pid=22858) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22858)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=22869): Process ended prematurely: osmo-stp_10.42.42.5(pid=22869) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22869)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22887): Process ended prematurely: osmo-stp_10.42.42.5(pid=22887) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22887)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=22903): Process ended prematurely: osmo-stp_10.42.42.5(pid=22903) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22903)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=22921): Process ended prematurely: osmo-stp_10.42.42.5(pid=22921) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22921)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=22932): Process ended prematurely: osmo-stp_10.42.42.5(pid=22932) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22932)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22942): Process ended prematurely: osmo-stp_10.42.42.5(pid=22942) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22942)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=22959): Process ended prematurely: osmo-stp_10.42.42.5(pid=22959) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22959)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=22971): Process ended prematurely: osmo-stp_10.42.42.5(pid=22971) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22971)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=22989): Process ended prematurely: osmo-stp_10.42.42.5(pid=22989) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22989)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=22999): Process ended prematurely: osmo-stp_10.42.42.5(pid=22999) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=22999)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=23009): Process ended prematurely: osmo-stp_10.42.42.5(pid=23009) [trial-2401↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23009)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=23022): Process ended prematurely: osmo-stp_10.42.42.5(pid=23022) [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23022)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23035): Process ended prematurely: osmo-stp_10.42.42.5(pid=23035) [trial-2401↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23035)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=23044): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23044) [trial-2401↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23044)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23057): Process ended prematurely: osmo-stp_10.42.42.5(pid=23057) [trial-2401↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23057)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23067): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23067) [trial-2401↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23067)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=23077): Process ended prematurely: osmo-stp_10.42.42.5(pid=23077) [trial-2401↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23077)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23091): Process ended prematurely: osmo-stp_10.42.42.5(pid=23091) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23091)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23102): Process ended prematurely: osmo-stp_10.42.42.5(pid=23102) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23102)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23116): Process ended prematurely: osmo-stp_10.42.42.5(pid=23116) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23116)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23127): Process ended prematurely: osmo-stp_10.42.42.5(pid=23127) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23127)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23143): Process ended prematurely: osmo-stp_10.42.42.5(pid=23143) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23143)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23154): Process ended prematurely: osmo-stp_10.42.42.5(pid=23154) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23154)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23168): Process ended prematurely: osmo-stp_10.42.42.5(pid=23168) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23168)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23179): Process ended prematurely: osmo-stp_10.42.42.5(pid=23179) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23179)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23196): Process ended prematurely: osmo-stp_10.42.42.5(pid=23196) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23196)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=23207): Process ended prematurely: osmo-stp_10.42.42.5(pid=23207) [trial-2401↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23207)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23221): Process ended prematurely: osmo-stp_10.42.42.5(pid=23221) [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23221)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23232): Process ended prematurely: osmo-stp_10.42.42.5(pid=23232) [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23232)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23248): Process ended prematurely: osmo-stp_10.42.42.5(pid=23248) [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23248)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23259): Process ended prematurely: osmo-stp_10.42.42.5(pid=23259) [trial-2401↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23259)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23273): Process ended prematurely: osmo-stp_10.42.42.5(pid=23273) [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23273)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=23284): Process ended prematurely: osmo-stp_10.42.42.5(pid=23284) [trial-2401↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23284)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=23298): Process ended prematurely: osmo-stp_10.42.42.5(pid=23298) [trial-2401↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23298)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23310): Process ended prematurely: osmo-stp_10.42.42.5(pid=23310) [trial-2401↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23310)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23328): Process ended prematurely: osmo-stp_10.42.42.5(pid=23328) [trial-2401↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23328)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=23340): Process ended prematurely: osmo-stp_10.42.42.5(pid=23340) [trial-2401↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23340)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=23358): Process ended prematurely: osmo-stp_10.42.42.5(pid=23358) [trial-2401↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23358)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23369): Process ended prematurely: osmo-stp_10.42.42.5(pid=23369) [trial-2401↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23369)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=23379): Process ended prematurely: osmo-stp_10.42.42.5(pid=23379) [trial-2401↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23379)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=23396): Process ended prematurely: osmo-stp_10.42.42.5(pid=23396) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23396)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=23408): Process ended prematurely: osmo-stp_10.42.42.5(pid=23408) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23408)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=23426): Process ended prematurely: osmo-stp_10.42.42.5(pid=23426) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23426)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=23436): Process ended prematurely: osmo-stp_10.42.42.5(pid=23436) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23436)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=23446): Process ended prematurely: osmo-stp_10.42.42.5(pid=23446) [trial-2401↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23446)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23463): Process ended prematurely: osmo-stp_10.42.42.5(pid=23463) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23463)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=23746): Process ended prematurely: osmo-stp_10.42.42.5(pid=23746) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23746)] FAIL: iperf3m4.py (11.6 sec) Error: osmo-stp_10.42.42.5(pid=23764): Process ended prematurely: osmo-stp_10.42.42.5(pid=23764) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23764)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23775): Process ended prematurely: osmo-stp_10.42.42.5(pid=23775) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23775)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23785): Process ended prematurely: osmo-stp_10.42.42.5(pid=23785) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23785)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=23804): Process ended prematurely: osmo-stp_10.42.42.5(pid=23804) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23804)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=23819): Process ended prematurely: osmo-stp_10.42.42.5(pid=23819) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23819)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=23837): Process ended prematurely: osmo-stp_10.42.42.5(pid=23837) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23837)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23847): Process ended prematurely: osmo-stp_10.42.42.5(pid=23847) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23847)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23857): Process ended prematurely: osmo-stp_10.42.42.5(pid=23857) [trial-2401↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23857)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=23877): Process ended prematurely: osmo-stp_10.42.42.5(pid=23877) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23877)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=23889): Process ended prematurely: osmo-stp_10.42.42.5(pid=23889) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23889)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=23907): Process ended prematurely: osmo-stp_10.42.42.5(pid=23907) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23907)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=23917): Process ended prematurely: osmo-stp_10.42.42.5(pid=23917) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23917)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23928): Process ended prematurely: osmo-stp_10.42.42.5(pid=23928) [trial-2401↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23928)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23941): Process ended prematurely: osmo-stp_10.42.42.5(pid=23941) [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23941)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=23964): Process ended prematurely: osmo-stp_10.42.42.5(pid=23964) [trial-2401↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23964)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=23972): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23972) [trial-2401↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23972)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=23982): Process ended prematurely: osmo-stp_10.42.42.5(pid=23982) [trial-2401↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23982)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=23991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23991) [trial-2401↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23991)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24001): Process ended prematurely: osmo-stp_10.42.42.5(pid=24001) [trial-2401↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24001)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24015): Process ended prematurely: osmo-stp_10.42.42.5(pid=24015) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24015)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24026): Process ended prematurely: osmo-stp_10.42.42.5(pid=24026) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24026)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24040): Process ended prematurely: osmo-stp_10.42.42.5(pid=24040) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24040)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24051): Process ended prematurely: osmo-stp_10.42.42.5(pid=24051) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24051)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24065): Process ended prematurely: osmo-stp_10.42.42.5(pid=24065) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24065)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24076): Process ended prematurely: osmo-stp_10.42.42.5(pid=24076) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24076)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24090): Process ended prematurely: osmo-stp_10.42.42.5(pid=24090) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24090)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24101): Process ended prematurely: osmo-stp_10.42.42.5(pid=24101) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24101)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24115): Process ended prematurely: osmo-stp_10.42.42.5(pid=24115) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24115)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24139): Process ended prematurely: osmo-stp_10.42.42.5(pid=24139) [trial-2401↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24139)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24153): Process ended prematurely: osmo-stp_10.42.42.5(pid=24153) [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24153)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24164): Process ended prematurely: osmo-stp_10.42.42.5(pid=24164) [trial-2401↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24164)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24181): Process ended prematurely: osmo-stp_10.42.42.5(pid=24181) [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24181)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24192): Process ended prematurely: osmo-stp_10.42.42.5(pid=24192) [trial-2401↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24192)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24206): Process ended prematurely: osmo-stp_10.42.42.5(pid=24206) [trial-2401↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24206)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24217): Process ended prematurely: osmo-stp_10.42.42.5(pid=24217) [trial-2401↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24217)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=24240): Process ended prematurely: osmo-stp_10.42.42.5(pid=24240) [trial-2401↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24240)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24252): Process ended prematurely: osmo-stp_10.42.42.5(pid=24252) [trial-2401↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24252)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=24270): Process ended prematurely: osmo-stp_10.42.42.5(pid=24270) [trial-2401↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24270)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24280): Process ended prematurely: osmo-stp_10.42.42.5(pid=24280) [trial-2401↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24280)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24290): Process ended prematurely: osmo-stp_10.42.42.5(pid=24290) [trial-2401↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24290)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24308): Process ended prematurely: osmo-stp_10.42.42.5(pid=24308) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24308)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24320): Process ended prematurely: osmo-stp_10.42.42.5(pid=24320) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24320)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=24339): Process ended prematurely: osmo-stp_10.42.42.5(pid=24339) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24339)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24349): Process ended prematurely: osmo-stp_10.42.42.5(pid=24349) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24349)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24359): Process ended prematurely: osmo-stp_10.42.42.5(pid=24359) [trial-2401↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24359)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=24378): Process ended prematurely: osmo-stp_10.42.42.5(pid=24378) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24378)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24390): Process ended prematurely: osmo-stp_10.42.42.5(pid=24390) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24390)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=24408): Process ended prematurely: osmo-stp_10.42.42.5(pid=24408) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24408)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24418): Process ended prematurely: osmo-stp_10.42.42.5(pid=24418) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24418)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24428): Process ended prematurely: osmo-stp_10.42.42.5(pid=24428) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24428)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24448): Process ended prematurely: osmo-stp_10.42.42.5(pid=24448) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24448)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24460): Process ended prematurely: osmo-stp_10.42.42.5(pid=24460) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24460)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=24478): Process ended prematurely: osmo-stp_10.42.42.5(pid=24478) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24478)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24488): Process ended prematurely: osmo-stp_10.42.42.5(pid=24488) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24488)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24498): Process ended prematurely: osmo-stp_10.42.42.5(pid=24498) [trial-2401↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24498)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24511): Process ended prematurely: osmo-stp_10.42.42.5(pid=24511) [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24511)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=24534): Process ended prematurely: osmo-stp_10.42.42.5(pid=24534) [trial-2401↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24534)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=24813): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24813) [trial-2401↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24813)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25081): Process ended prematurely: osmo-stp_10.42.42.5(pid=25081) [trial-2401↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25081)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=25091): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25091) [trial-2401↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25091)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25101): Process ended prematurely: osmo-stp_10.42.42.5(pid=25101) [trial-2401↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25101)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25115): Process ended prematurely: osmo-stp_10.42.42.5(pid=25115) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25115)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25126): Process ended prematurely: osmo-stp_10.42.42.5(pid=25126) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25126)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25140): Process ended prematurely: osmo-stp_10.42.42.5(pid=25140) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25140)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25151): Process ended prematurely: osmo-stp_10.42.42.5(pid=25151) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25151)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25165): Process ended prematurely: osmo-stp_10.42.42.5(pid=25165) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25165)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25176): Process ended prematurely: osmo-stp_10.42.42.5(pid=25176) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25176)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25190): Process ended prematurely: osmo-stp_10.42.42.5(pid=25190) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25190)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25201): Process ended prematurely: osmo-stp_10.42.42.5(pid=25201) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25201)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25216): Process ended prematurely: osmo-stp_10.42.42.5(pid=25216) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25216)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25227): Process ended prematurely: osmo-stp_10.42.42.5(pid=25227) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25227)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25243): Process ended prematurely: osmo-stp_10.42.42.5(pid=25243) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25243)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25254): Process ended prematurely: osmo-stp_10.42.42.5(pid=25254) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25254)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25269): Process ended prematurely: osmo-stp_10.42.42.5(pid=25269) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25269)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25280): Process ended prematurely: osmo-stp_10.42.42.5(pid=25280) [trial-2401↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25280)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25294): Process ended prematurely: osmo-stp_10.42.42.5(pid=25294) [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25294)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25305): Process ended prematurely: osmo-stp_10.42.42.5(pid=25305) [trial-2401↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25305)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=25323): Process ended prematurely: osmo-stp_10.42.42.5(pid=25323) [trial-2401↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25323)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25605): Process ended prematurely: osmo-stp_10.42.42.5(pid=25605) [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25605)] FAIL: iperf3m4.py (12.2 sec) Error: osmo-stp_10.42.42.5(pid=25625): Process ended prematurely: osmo-stp_10.42.42.5(pid=25625) [trial-2401↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25625)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25636): Process ended prematurely: osmo-stp_10.42.42.5(pid=25636) [trial-2401↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25636)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25646): Process ended prematurely: osmo-stp_10.42.42.5(pid=25646) [trial-2401↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25646)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25663): Process ended prematurely: osmo-stp_10.42.42.5(pid=25663) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25663)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=25678): Process ended prematurely: osmo-stp_10.42.42.5(pid=25678) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25678)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=25696): Process ended prematurely: osmo-stp_10.42.42.5(pid=25696) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25696)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25706): Process ended prematurely: osmo-stp_10.42.42.5(pid=25706) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25706)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25716): Process ended prematurely: osmo-stp_10.42.42.5(pid=25716) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25716)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=25736): Process ended prematurely: osmo-stp_10.42.42.5(pid=25736) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25736)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=25748): Process ended prematurely: osmo-stp_10.42.42.5(pid=25748) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25748)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=25766): Process ended prematurely: osmo-stp_10.42.42.5(pid=25766) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25766)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25776): Process ended prematurely: osmo-stp_10.42.42.5(pid=25776) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25776)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25786): Process ended prematurely: osmo-stp_10.42.42.5(pid=25786) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25786)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=25803): Process ended prematurely: osmo-stp_10.42.42.5(pid=25803) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25803)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=25815): Process ended prematurely: osmo-stp_10.42.42.5(pid=25815) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25815)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=25833): Process ended prematurely: osmo-stp_10.42.42.5(pid=25833) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25833)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25843): Process ended prematurely: osmo-stp_10.42.42.5(pid=25843) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25843)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=25853): Process ended prematurely: osmo-stp_10.42.42.5(pid=25853) [trial-2401↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25853)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25869): Process ended prematurely: osmo-stp_10.42.42.5(pid=25869) [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25869)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25882): Process ended prematurely: osmo-stp_10.42.42.5(pid=25882) [trial-2401↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25882)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=25891): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25891) [trial-2401↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25891)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25901): Process ended prematurely: osmo-stp_10.42.42.5(pid=25901) [trial-2401↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25901)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=25910): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25910) [trial-2401↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25910)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25920): Process ended prematurely: osmo-stp_10.42.42.5(pid=25920) [trial-2401↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25920)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25934): Process ended prematurely: osmo-stp_10.42.42.5(pid=25934) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25934)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25945): Process ended prematurely: osmo-stp_10.42.42.5(pid=25945) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25945)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25959): Process ended prematurely: osmo-stp_10.42.42.5(pid=25959) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25959)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25970): Process ended prematurely: osmo-stp_10.42.42.5(pid=25970) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25970)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25985): Process ended prematurely: osmo-stp_10.42.42.5(pid=25985) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25985)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25996): Process ended prematurely: osmo-stp_10.42.42.5(pid=25996) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25996)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26010): Process ended prematurely: osmo-stp_10.42.42.5(pid=26010) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26010)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26024): Process ended prematurely: osmo-stp_10.42.42.5(pid=26024) [trial-2401↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26024)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26038): Process ended prematurely: osmo-stp_10.42.42.5(pid=26038) [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26038)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26049): Process ended prematurely: osmo-stp_10.42.42.5(pid=26049) [trial-2401↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26049)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26064): Process ended prematurely: osmo-stp_10.42.42.5(pid=26064) [trial-2401↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26064)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26075): Process ended prematurely: osmo-stp_10.42.42.5(pid=26075) [trial-2401↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26075)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26095): Process ended prematurely: osmo-stp_10.42.42.5(pid=26095) [trial-2401↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26095)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26107): Process ended prematurely: osmo-stp_10.42.42.5(pid=26107) [trial-2401↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26107)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26125): Process ended prematurely: osmo-stp_10.42.42.5(pid=26125) [trial-2401↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26125)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26135): Process ended prematurely: osmo-stp_10.42.42.5(pid=26135) [trial-2401↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26135)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26145): Process ended prematurely: osmo-stp_10.42.42.5(pid=26145) [trial-2401↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26145)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=26163): Process ended prematurely: osmo-stp_10.42.42.5(pid=26163) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26163)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26177): Process ended prematurely: osmo-stp_10.42.42.5(pid=26177) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26177)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26195): Process ended prematurely: osmo-stp_10.42.42.5(pid=26195) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26195)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26207): Process ended prematurely: osmo-stp_10.42.42.5(pid=26207) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26207)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26217): Process ended prematurely: osmo-stp_10.42.42.5(pid=26217) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26217)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26255): Process ended prematurely: osmo-stp_10.42.42.5(pid=26255) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26255)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26267): Process ended prematurely: osmo-stp_10.42.42.5(pid=26267) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26267)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=26285): Process ended prematurely: osmo-stp_10.42.42.5(pid=26285) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26285)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26296): Process ended prematurely: osmo-stp_10.42.42.5(pid=26296) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26296)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26306): Process ended prematurely: osmo-stp_10.42.42.5(pid=26306) [trial-2401↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26306)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=26320): Process ended prematurely: osmo-stp_10.42.42.5(pid=26320) [trial-2401↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26320)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26333): Process ended prematurely: osmo-stp_10.42.42.5(pid=26333) [trial-2401↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26333)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=26342): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26342) [trial-2401↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26342)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26352): Process ended prematurely: osmo-stp_10.42.42.5(pid=26352) [trial-2401↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26352)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26368): Process ended prematurely: osmo-stp_10.42.42.5(pid=26368) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26368)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26379): Process ended prematurely: osmo-stp_10.42.42.5(pid=26379) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26379)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26397): Process ended prematurely: osmo-stp_10.42.42.5(pid=26397) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26397)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26408): Process ended prematurely: osmo-stp_10.42.42.5(pid=26408) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26408)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26422): Process ended prematurely: osmo-stp_10.42.42.5(pid=26422) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26422)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26433): Process ended prematurely: osmo-stp_10.42.42.5(pid=26433) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26433)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26447): Process ended prematurely: osmo-stp_10.42.42.5(pid=26447) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26447)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26459): Process ended prematurely: osmo-stp_10.42.42.5(pid=26459) [trial-2401↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26459)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26473): Process ended prematurely: osmo-stp_10.42.42.5(pid=26473) [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26473)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26484): Process ended prematurely: osmo-stp_10.42.42.5(pid=26484) [trial-2401↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26484)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26498): Process ended prematurely: osmo-stp_10.42.42.5(pid=26498) [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26498)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26509): Process ended prematurely: osmo-stp_10.42.42.5(pid=26509) [trial-2401↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26509)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26524): Process ended prematurely: osmo-stp_10.42.42.5(pid=26524) [trial-2401↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26524)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26535): Process ended prematurely: osmo-stp_10.42.42.5(pid=26535) [trial-2401↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26535)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26553): Process ended prematurely: osmo-stp_10.42.42.5(pid=26553) [trial-2401↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26553)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26565): Process ended prematurely: osmo-stp_10.42.42.5(pid=26565) [trial-2401↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26565)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=26583): Process ended prematurely: osmo-stp_10.42.42.5(pid=26583) [trial-2401↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26583)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26593): Process ended prematurely: osmo-stp_10.42.42.5(pid=26593) [trial-2401↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26593)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26603): Process ended prematurely: osmo-stp_10.42.42.5(pid=26603) [trial-2401↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26603)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26620): Process ended prematurely: osmo-stp_10.42.42.5(pid=26620) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26620)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26632): Process ended prematurely: osmo-stp_10.42.42.5(pid=26632) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26632)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26650): Process ended prematurely: osmo-stp_10.42.42.5(pid=26650) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26650)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26660): Process ended prematurely: osmo-stp_10.42.42.5(pid=26660) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26660)] FAIL: ping_idle_ping.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26942): Process ended prematurely: osmo-stp_10.42.42.5(pid=26942) [trial-2401↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26942)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.8 sec) Error: osmo-stp_10.42.42.5(pid=26959): Process ended prematurely: osmo-stp_10.42.42.5(pid=26959) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26959)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=26972): Process ended prematurely: osmo-stp_10.42.42.5(pid=26972) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26972)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26990): Process ended prematurely: osmo-stp_10.42.42.5(pid=26990) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26990)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=27004): Process ended prematurely: osmo-stp_10.42.42.5(pid=27004) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27004)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27014): Process ended prematurely: osmo-stp_10.42.42.5(pid=27014) [trial-2401↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27014)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=27031): Process ended prematurely: osmo-stp_10.42.42.5(pid=27031) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27031)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27043): Process ended prematurely: osmo-stp_10.42.42.5(pid=27043) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27043)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=27061): Process ended prematurely: osmo-stp_10.42.42.5(pid=27061) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27061)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27073): Process ended prematurely: osmo-stp_10.42.42.5(pid=27073) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27073)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27083): Process ended prematurely: osmo-stp_10.42.42.5(pid=27083) [trial-2401↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27083)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27098): Process ended prematurely: osmo-stp_10.42.42.5(pid=27098) [trial-2401↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27098)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=27106): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27106) [trial-2401↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27106)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=27108): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27108) [trial-2401↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27108)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=27110): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27110) [trial-2401↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27110)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=27112): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27112) [trial-2401↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27112)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=27121): Process ended prematurely: osmo-hlr_10.42.42.2(pid=27121) [trial-2401↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27121)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=27132): Process ended prematurely: osmo-hlr_10.42.42.2(pid=27132) [trial-2401↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27132)] FAIL: esme_ms_sms_storeforward.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27144): Process ended prematurely: osmo-stp_10.42.42.5(pid=27144) [trial-2401↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27144)] FAIL: esme_ms_sms_transaction.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27155): Process ended prematurely: osmo-stp_10.42.42.5(pid=27155) [trial-2401↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27155)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27169): Process ended prematurely: osmo-stp_10.42.42.5(pid=27169) [trial-2401↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27169)] FAIL: register_a5_0_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27180): Process ended prematurely: osmo-stp_10.42.42.5(pid=27180) [trial-2401↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27180)] FAIL: register_a5_1_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27191): Process ended prematurely: osmo-stp_10.42.42.5(pid=27191) [trial-2401↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27191)] FAIL: register_a5_3_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27202): Process ended prematurely: osmo-stp_10.42.42.5(pid=27202) [trial-2401↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27202)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.2 sec) Error: srsepc(pid=27222): Process ended prematurely: srsepc(pid=27222) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27222)] FAIL: iperf3_bidir.py (18.7 sec) Error: srsepc(pid=27238): Process ended prematurely: srsepc(pid=27238) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27238)] FAIL: iperf3_dl.py (19.4 sec) Error: srsepc(pid=27254): Process ended prematurely: srsepc(pid=27254) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27254)] FAIL: iperf3_ul.py (19.3 sec) Error: srsepc(pid=27270): Process ended prematurely: srsepc(pid=27270) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27270)] FAIL: ping.py (18.8 sec) Error: srsepc(pid=27286): Process ended prematurely: srsepc(pid=27286) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27286)] FAIL: rrc_idle_mo_ping.py (18.8 sec) Error: srsepc(pid=27302): Process ended prematurely: srsepc(pid=27302) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27302)] FAIL: rrc_idle_mt_ping.py (18.8 sec) Error: srsepc(pid=27322): Process ended prematurely: srsepc(pid=27322) [trial-2401↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=27322)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27337): Process ended prematurely: osmo-stp_10.42.42.5(pid=27337) [trial-2401↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27337)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27351): Process ended prematurely: osmo-stp_10.42.42.5(pid=27351) [trial-2401↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27351)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27365): Process ended prematurely: osmo-stp_10.42.42.5(pid=27365) [trial-2401↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27365)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27379): Process ended prematurely: osmo-stp_10.42.42.5(pid=27379) [trial-2401↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27379)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27394): Process ended prematurely: osmo-stp_10.42.42.5(pid=27394) [trial-2401↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27394)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27408): Process ended prematurely: osmo-stp_10.42.42.5(pid=27408) [trial-2401↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27408)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27422): Process ended prematurely: osmo-stp_10.42.42.5(pid=27422) [trial-2401↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27422)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27436): Process ended prematurely: osmo-stp_10.42.42.5(pid=27436) [trial-2401↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27436)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27451): Process ended prematurely: osmo-stp_10.42.42.5(pid=27451) [trial-2401↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27451)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=27465): Process ended prematurely: osmo-stp_10.42.42.5(pid=27465) [trial-2401↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27465)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27482): Process ended prematurely: osmo-stp_10.42.42.5(pid=27482) [trial-2401↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27482)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27496): Process ended prematurely: osmo-stp_10.42.42.5(pid=27496) [trial-2401↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27496)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27511): Process ended prematurely: osmo-stp_10.42.42.5(pid=27511) [trial-2401↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27511)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27525): Process ended prematurely: osmo-stp_10.42.42.5(pid=27525) [trial-2401↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27525)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27540): Process ended prematurely: osmo-stp_10.42.42.5(pid=27540) [trial-2401↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27540)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27554): Process ended prematurely: osmo-stp_10.42.42.5(pid=27554) [trial-2401↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27554)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27568): Process ended prematurely: osmo-stp_10.42.42.5(pid=27568) [trial-2401↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27568)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27582): Process ended prematurely: osmo-stp_10.42.42.5(pid=27582) [trial-2401↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27582)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=27596): Process ended prematurely: osmo-stp_10.42.42.5(pid=27596) [trial-2401↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27596)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27610): Process ended prematurely: osmo-stp_10.42.42.5(pid=27610) [trial-2401↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27610)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27624): Process ended prematurely: osmo-stp_10.42.42.5(pid=27624) [trial-2401↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27624)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27638): Process ended prematurely: osmo-stp_10.42.42.5(pid=27638) [trial-2401↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27638)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=27652): Process ended prematurely: osmo-stp_10.42.42.5(pid=27652) [trial-2401↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27652)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27667): Process ended prematurely: osmo-stp_10.42.42.5(pid=27667) [trial-2401↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27667)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27681): Process ended prematurely: osmo-stp_10.42.42.5(pid=27681) [trial-2401↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27681)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27698): Process ended prematurely: osmo-stp_10.42.42.5(pid=27698) [trial-2401↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27698)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27713): Process ended prematurely: osmo-stp_10.42.42.5(pid=27713) [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27713)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=27727): Process ended prematurely: osmo-stp_10.42.42.5(pid=27727) [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27727)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27741): Process ended prematurely: osmo-stp_10.42.42.5(pid=27741) [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27741)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27759): Process ended prematurely: osmo-stp_10.42.42.5(pid=27759) [trial-2401↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27759)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27773): Process ended prematurely: osmo-stp_10.42.42.5(pid=27773) [trial-2401↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27773)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=27787): Process ended prematurely: osmo-stp_10.42.42.5(pid=27787) [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27787)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27801): Process ended prematurely: osmo-stp_10.42.42.5(pid=27801) [trial-2401↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27801)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27815): Process ended prematurely: osmo-stp_10.42.42.5(pid=27815) [trial-2401↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27815)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27829): Process ended prematurely: osmo-stp_10.42.42.5(pid=27829) [trial-2401↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27829)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27844): Process ended prematurely: osmo-stp_10.42.42.5(pid=27844) [trial-2401↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27844)] + rm -rf trial-2401/inst + cd trial-2401 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-14 06:56:55 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401-run.tgz run.2022-12-14_06-57-06 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2401-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17686.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2995.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29315.tgz osmo-nitb.build-12995.tgz osmo-pcu-oc2g.build-3912.tgz osmo-pcu-sysmo.build-5195.tgz osmo-pcu.build-5156.tgz osmo-sgsn.build-30101.tgz osmo-stp.build-9260.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE